Jul 09 15:01:45 devstack cinder-volume[75678]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 15:01:45 devstack cinder-volume[75678]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 15:01:45 devstack cinder-volume[75678]: we strongly recommend against using it for new projects. Jul 09 15:01:45 devstack cinder-volume[75678]: If you are already using Eventlet, we recommend migrating to a different Jul 09 15:01:45 devstack cinder-volume[75678]: framework. For more detail see Jul 09 15:01:45 devstack cinder-volume[75678]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 15:01:45 devstack cinder-volume[75678]: import eventlet # noqa Jul 09 15:01:47 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:01:47 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:01:47 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:01:48 devstack cinder-volume[75678]: INFO dbcounter [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Registered counter for database cinder Jul 09 15:01:48 devstack cinder-volume[75678]: DEBUG oslo_db.sqlalchemy.engines [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:01:49 devstack cinder-volume[75678]: DEBUG dbcounter [-] [75678] Writer thread running {{(pid=75678) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 15:01:49 devstack cinder-volume[75678]: INFO cinder.rpc [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 15:01:49 devstack cinder-volume[75678]: INFO cinder.rpc [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 15:01:49 devstack cinder-volume[75678]: DEBUG oslo_db.sqlalchemy.engines [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:01:49 devstack cinder-volume[75678]: INFO cinder.volume.manager [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Determined volume DB was empty at startup. Jul 09 15:01:49 devstack cinder-volume[75678]: DEBUG cinder.volume.manager [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75678) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 15:01:49 devstack cinder-volume[75678]: INFO cinder.volume.manager [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 15:01:49 devstack cinder-volume[75678]: WARNING stevedore.named [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 15:01:49 devstack cinder-volume[75678]: WARNING castellan.key_manager [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:01:49 devstack cinder-volume[75678]: WARNING cinder.keymgr.conf_key_mgr [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:01:49 devstack cinder-volume[75678]: DEBUG cinder.volume.drivers.lvm [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75678) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 09 15:01:49 devstack cinder-volume[75678]: DEBUG oslo_concurrency.processutils [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:49 devstack cinder-volume[75678]: DEBUG oslo_concurrency.processutils [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] CMD "cinder-rtstool verify" returned: 0 in 0.449s {{(pid=75678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:49 devstack cinder-volume[75678]: DEBUG oslo_db.sqlalchemy.engines [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:01:49 devstack cinder-volume[75678]: INFO cinder.rpc [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 15:01:49 devstack cinder-volume[75678]: INFO cinder.rpc [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 15:01:49 devstack cinder-volume[75678]: WARNING stevedore.named [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 15:01:49 devstack cinder-volume[75678]: WARNING castellan.key_manager [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:01:49 devstack cinder-volume[75678]: INFO cinder.volume.manager [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_db.sqlalchemy.engines [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:01:50 devstack cinder-volume[75678]: INFO oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Starting 1 workers Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Started child 75837 {{(pid=75678) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Full set of CONF: {{(pid=75678) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] ******************************************************************************** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Configuration options gathered from: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 15:01:50 devstack cinder-volume[75837]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] ================================================================================ {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] allow_availability_zone_fallback = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] allow_compression_on_image_upload = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] allowed_direct_url_schemes = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] api_rate_limit = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] auth_strategy = keystone {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] az_cache_duration = 3600 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_availability_zone = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_host = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_stats_polling_interval = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backup_api_class = cinder.backup.api.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backup_name_template = backup-%s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backup_use_same_host = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backup_use_temp_snapshot = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] chap_password = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] chap_username = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cinder_internal_tenant_project_id = 974159a544f94ba3bdf4a12e5096590e {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cinder_internal_tenant_user_id = 6389a917d4ee453684c016e8ce8a31e4 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cloned_volume_same_az = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cluster = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] compression_format = gzip {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] compute_api_class = cinder.compute.nova.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] config_dir = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] config_source = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] control_exchange = openstack {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] debug = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] default_availability_zone = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] default_group_type = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] default_volume_type = lvmdriver-1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] disk_geometry = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] driver_client_cert = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] driver_client_cert_key = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] driver_data_namespace = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] driver_ssl_cert_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] driver_ssl_cert_verify = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] driver_use_ssl = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] enable_force_upload = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] enable_new_services = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] enable_unsupported_driver = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] enabled_backends = ['lvmdriver-1'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] enforce_multipath_for_image_xfer = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] filter_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance_api_insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance_api_servers = ['http://192.168.122.104/image'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance_api_ssl_compression = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75837]: INFO cinder.volume.manager [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance_ca_certificates_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance_catalog_info = image:glance:publicURL {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance_certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance_keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance_num_retries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance_request_timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] goodness_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] graceful_shutdown_timeout = 5 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] group_api_class = cinder.group.api.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] host = devstack {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] image_compress_on_upload = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] image_conversion_address_space_limit = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] image_conversion_cpu_limit = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] image_conversion_disable = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] image_upload_use_cinder_backend = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] image_upload_use_internal_tenant = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] image_volume_cache_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] image_volume_cache_max_count = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] image_volume_cache_max_size_gb = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] init_host_max_objects_retrieval = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] instance_format = [instance: %(uuid)s] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] iscsi_target_flags = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] iscsi_write_cache = on {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] iser_helper = tgtadm {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] iser_ip_address = 192.168.122.104 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] iser_port = 3260 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] log_color = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] log_config_append = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] log_dir = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] log_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] log_options = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] log_rotate_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] log_rotate_interval_type = days {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] log_rotation_type = none {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] max_age = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] max_logfile_count = 30 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] max_logfile_size_mb = 200 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] max_over_subscription_ratio = 20.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] message_reap_interval = 86400 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] message_ttl = 2592000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] migration_create_volume_timeout_secs = 300 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] monkey_patch = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] monkey_patch_modules = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] my_ip = 192.168.122.104 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] no_snapshot_gb_quota = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] num_iser_scan_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] num_shell_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] num_volume_device_scan_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] nvmeof_conn_info_version = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] nvmet_ns_id = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] nvmet_port_id = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] osapi_max_limit = 1000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] osapi_volume_ext_list = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] osapi_volume_listen = 0.0.0.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] osapi_volume_listen_port = 8776 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] osapi_volume_use_ssl = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] osapi_volume_workers = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] per_volume_size_limit = -1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] periodic_fuzzy_delay = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] periodic_interval = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] project_id_regex = [0-9a-f\-]+ {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] public_endpoint = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] publish_errors = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] quota_backup_gigabytes = 1000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] quota_backups = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] quota_gigabytes = 1000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] quota_groups = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] quota_snapshots = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] quota_volumes = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] rate_limit_burst = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] rate_limit_except_level = CRITICAL {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] rate_limit_interval = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] reinit_driver_count = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] replication_device = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] report_discard_supported = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] report_interval = 120 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] reservation_clean_interval = 86400 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] reservation_expire = 86400 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] reserved_image_namespaces = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] reserved_percentage = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] rpc_response_timeout = 120 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] run_external_periodic_tasks = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] scst_target_driver = iscsi {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] scst_target_iqn_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_down_time = 720 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] shell_completion = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] snapshot_name_template = snapshot-%s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] snapshot_same_host = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] split_loggers = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] state_path = /opt/stack/data/cinder {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] storage_availability_zone = nova {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] storage_protocol = iSCSI {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] syslog_log_facility = LOG_USER {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] target_helper = lioadm {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] target_ip_address = 192.168.122.104 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] target_port = 3260 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] target_protocol = iscsi {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:50 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] target_secondary_ip_addresses = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] trace_flags = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] transfer_api_class = cinder.transfer.api.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] transport_url = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] until_refresh = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] use_chap_auth = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] use_default_quota_class = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] use_journal = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] use_json = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] use_multipath_for_image_xfer = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] use_stderr = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] use_syslog = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] verify_glance_signatures = enabled {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_api_class = cinder.volume.api.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_backend_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_clear = zero {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_clear_ionice = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_clear_size = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_copy_bps_limit = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_dd_blocksize = 1M {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_name_template = volume-%s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_service_inithost_offload = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volume_usage_audit_period = month {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] zoning_mode = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_concurrency.disable_process_locking = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.auth_section = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.auth_type = password {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.auth_version = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.cache = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.delay_auth_decision = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.http_connect_timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.include_service_catalog = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.interface = public {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_password = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcache_username = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.region_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.service_token_roles_required = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.service_type = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.token_cache_time = 300 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.104/identity {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.backend = dogpile.cache.null {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.backend_argument = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.backend_expiration_time = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.config_prefix = cache.oslo {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.debug_cache_backend = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.enable_retry_client = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.enable_socket_keepalive = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.expiration_time = 600 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.hashclient_retry_attempts = 2 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.memcache_dead_retry = 300 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack sudo[75842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.memcache_pool_maxsize = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.memcache_sasl_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.password = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.proxies = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.redis_db = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.redis_sentinel_service_name = mymaster {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack sudo[75842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.redis_server = localhost:6379 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.retry_attempts = 2 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.retry_delay = 0.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.socket_keepalive_count = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.socket_keepalive_idle = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.socket_keepalive_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.socket_timeout = 1.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.tls_allowed_ciphers = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.tls_cafile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.tls_certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.tls_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.tls_keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cache.username = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] coordination.backend_url = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.asyncio_connection = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.asyncio_slave_connection = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.backend = sqlalchemy {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.connection = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.connection_debug = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.connection_parameters = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.connection_recycle_time = 3600 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.connection_trace = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.db_inc_retry_interval = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.db_max_retries = 20 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.db_max_retry_interval = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.db_retry_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.max_overflow = 50 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.max_pool_size = 5 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.max_retries = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.mysql_wsrep_sync_wait = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.pool_timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.retry_interval = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.slave_connection = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.sqlite_synchronous = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.synchronous_reader = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] database.use_db_reconnect = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.connection_string = messaging:// {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.es_doc_type = notification {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.es_scroll_size = 10000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.es_scroll_time = 2m {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.filter_error_trace = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.hmac_keys = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.sentinel_service_name = mymaster {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.socket_timeout = 0.1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.trace_requests = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler.trace_sqlalchemy = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler_jaeger.process_tags = {} {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler_jaeger.service_name_prefix = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] profiler_otlp.service_name_prefix = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.enforce_new_defaults = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.enforce_scope = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.policy_default_rule = default {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.policy_file = policy.yaml {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_policy.remote_timeout = 60.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] privsep_osbrick.group = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] privsep_osbrick.helper_command = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] privsep_osbrick.user = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cinder_sys_admin.group = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cinder_sys_admin.helper_command = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] cinder_sys_admin.user = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_user.auth_section = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_user.auth_type = password {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_user.cafile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_user.certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_user.collect_timing = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_user.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_user.keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_user.send_service_user_token = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_user.split_loggers = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] service_user.timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance.auth_section = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance.auth_type = password {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance.certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance.collect_timing = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance.keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance.region_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance.split_loggers = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] glance.timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.backend_availability_zone = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.chap_password = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.chap_username = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.disk_geometry = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.driver_client_cert = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.driver_client_cert_key = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.driver_data_namespace = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.driver_use_ssl = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.enable_unsupported_driver = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.extra_capabilities = {} {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.filter_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.goodness_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.iscsi_target_flags = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.iscsi_write_cache = on {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.iser_helper = tgtadm {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.iser_ip_address = 192.168.122.104 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.iser_port = 3260 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.lvm_mirrors = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.lvm_share_target = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.lvm_type = auto {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.num_shell_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.nvmet_port_id = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.replication_device = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.report_discard_supported = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.reserved_percentage = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.scst_target_driver = iscsi {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.scst_target_iqn_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.storage_protocol = iSCSI {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.target_helper = tgtadm {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.target_ip_address = 192.168.122.104 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.target_port = 3260 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.target_protocol = iscsi {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.trace_flags = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.unique_fqdn_network = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.use_chap_auth = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.volume_backend_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.volume_clear = zero {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.volume_clear_ionice = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.volume_clear_size = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.volume_group = cinder-volumes {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_reports.file_event_handler = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_reports.log_dir = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.backend_availability_zone = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.backend_host = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.chap_password = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.chap_username = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.chiscsi_conf = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.disk_geometry = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.driver_client_cert = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.driver_data_namespace = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.driver_use_ssl = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.extra_capabilities = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.filter_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.goodness_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.iser_helper = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.iser_ip_address = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.iser_port = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.iser_target_prefix = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.lvm_conf_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.lvm_mirrors = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.lvm_share_target = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.lvm_type = auto {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.num_shell_tries = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.nvmet_port_id = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.replication_device = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.report_discard_supported = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.reserved_percentage = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.scst_target_driver = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.storage_protocol = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.target_helper = lioadm {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.target_ip_address = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.target_port = 3260 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.target_protocol = iscsi {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.trace_flags = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.use_chap_auth = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.volume_clear = zero {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.volume_clear_size = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] lvmdriver-1.volumes_dir = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.ssl = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.ssl_version = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_notifications.driver = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_notifications.retry = -1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] oslo_messaging_notifications.transport_url = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] key_manager.fixed_key = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.barbican_api_version = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.barbican_endpoint = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.barbican_endpoint_type = public {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.barbican_region_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.cafile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.collect_timing = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.number_of_retries = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.retry_delay = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.send_service_user_token = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.split_loggers = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.verify_ssl = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican.verify_ssl_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican_service_user.auth_section = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican_service_user.auth_type = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican_service_user.cafile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican_service_user.certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican_service_user.collect_timing = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican_service_user.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican_service_user.keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican_service_user.split_loggers = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] barbican_service_user.timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.approle_role_id = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.approle_secret_id = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.kv_mountpoint = secret {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.kv_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.kv_version = 2 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.namespace = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.root_token_id = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.ssl_ca_crt_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.timeout = 60.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.use_ssl = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:01:50 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] ******************************************************************************** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 15:01:50 devstack sudo[75842]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:50 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.758s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:50 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:51 devstack sudo[75898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:01:51 devstack sudo[75898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:51 devstack sudo[75898]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.643s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:01:51 devstack cinder-volume[75837]: INFO cinder.brick.local_dev.lvm [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 15:01:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:51 devstack sudo[76128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:01:51 devstack sudo[76128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:52 devstack sudo[76128]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:52 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:52 devstack cinder-volume[75837]: DEBUG cinder.brick.local_dev.lvm [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75837) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 09 15:01:52 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:52 devstack sudo[76334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:01:52 devstack sudo[76334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:53 devstack sudo[76334]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.503s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:53 devstack sudo[76616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:01:53 devstack sudo[76616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:54 devstack sudo[76616]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:54 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:54 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:54 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:54 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:54 devstack sudo[76622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 15:01:54 devstack sudo[76622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:55 devstack sudo[76622]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:55 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.687s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:55 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:55 devstack sudo[76626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:01:55 devstack sudo[76626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:56 devstack sudo[76626]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:56 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.955s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:56 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:56 devstack sudo[76637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:01:56 devstack sudo[76637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:57 devstack sudo[76637]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:57 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.881s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:57 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:57 devstack sudo[76642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:01:57 devstack sudo[76642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:57 devstack sudo[76642]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:57 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.776s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:57 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:57 devstack sudo[76652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:01:57 devstack sudo[76652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:58 devstack sudo[76652]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:58 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:58 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:58 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:58 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:58 devstack sudo[76656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:01:58 devstack sudo[76656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:59 devstack sudo[76656]: pam_unix(sudo:session): session closed for user root Jul 09 15:01:59 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:59 devstack cinder-volume[75837]: INFO cinder.volume.drivers.lvm [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 15:01:59 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:59 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:01:59 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:01:59 devstack sudo[76669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:01:59 devstack sudo[76669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:01:59 devstack sudo[76669]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:00 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.738s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:00 devstack cinder-volume[75837]: DEBUG cinder.volume.drivers.lvm [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Updating volume stats {{(pid=75837) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 15:02:00 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:00 devstack sudo[76782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:02:00 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:00 devstack cinder-volume[75678]: DEBUG dbcounter [-] [75678] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75678) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:02:00 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:00 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:00 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:00 devstack sudo[76923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:02:00 devstack sudo[76923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:01 devstack sudo[76923]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:01 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:01 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:01 devstack sudo[76926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:02:01 devstack sudo[76926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:01 devstack sudo[76926]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:01 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:01 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:01 devstack sudo[76932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:02:01 devstack sudo[76932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:02 devstack sudo[76932]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:02 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:02 devstack cinder-volume[75837]: INFO cinder.volume.driver [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Driver hasn't implemented _init_vendor_properties() Jul 09 15:02:02 devstack cinder-volume[75837]: DEBUG cinder.volume.driver [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75837) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 15:02:02 devstack cinder-volume[75837]: DEBUG oslo_db.sqlalchemy.engines [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75837) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:02:02 devstack cinder-volume[75837]: DEBUG dbcounter [-] [75837] Writer thread running {{(pid=75837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 15:02:02 devstack cinder-volume[75837]: DEBUG cinder.db.api [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Building query based on filter {{(pid=75837) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 15:02:02 devstack cinder-volume[75837]: DEBUG cinder.image.image_utils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75837) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 15:02:02 devstack cinder-volume[75837]: INFO cinder.keymgr.migration [None req-b4def602-6b97-4050-92ca-229825655b26 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 15:02:02 devstack cinder-volume[75837]: DEBUG cinder.volume.drivers.lvm [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Updating volume stats {{(pid=75837) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 15:02:02 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:02 devstack sudo[76940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:02:02 devstack sudo[76940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:03 devstack sudo[76940]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:03 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:03 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:03 devstack sudo[76943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:02:03 devstack sudo[76943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:04 devstack sudo[76943]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:04 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:04 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:04 devstack sudo[76952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:02:04 devstack sudo[76952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:04 devstack sudo[76952]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:04 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:04 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:04 devstack sudo[76955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:02:04 devstack sudo[76955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:05 devstack sudo[76955]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:05 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:05 devstack cinder-volume[75837]: DEBUG cinder.manager [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Notifying Schedulers of capabilities ... {{(pid=75837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:02:05 devstack cinder-volume[75837]: INFO cinder.volume.manager [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Driver initialization completed successfully. Jul 09 15:02:05 devstack cinder-volume[75837]: INFO cinder.manager [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Initiating service 2 cleanup Jul 09 15:02:05 devstack cinder-volume[75837]: INFO cinder.manager [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Service 2 cleanup completed. Jul 09 15:02:05 devstack cinder-volume[75837]: DEBUG cinder.service [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Creating RPC server for service cinder-volume {{(pid=75837) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 15:02:05 devstack cinder-volume[75837]: DEBUG cinder.service [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75837) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 15:02:05 devstack cinder-volume[75837]: INFO cinder.volume.manager [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 15:02:05 devstack cinder-volume[75837]: DEBUG cinder.volume.drivers.lvm [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Updating volume stats {{(pid=75837) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 15:02:05 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:05 devstack sudo[76959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:02:05 devstack sudo[76959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:06 devstack sudo[76959]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:06 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:06 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:06 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:02:06 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:06 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:06 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:06 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:06 devstack sudo[76969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:02:06 devstack sudo[76969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:07 devstack sudo[76969]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:07 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:07 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:07 devstack sudo[77026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:02:07 devstack sudo[77026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:08 devstack sudo[77026]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:08 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:08 devstack cinder-volume[75837]: INFO cinder.volume.manager [None req-ee0f068e-2edc-44f6-a127-e6848c5197da None None] Driver post RPC initialization completed successfully. Jul 09 15:02:18 devstack cinder-volume[75837]: DEBUG dbcounter [-] [75837] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:02:18 devstack cinder-volume[75837]: DEBUG dbcounter [-] [75837] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:02:51 devstack cinder-volume[75837]: DEBUG oslo_service.periodic_task [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:02:51 devstack cinder-volume[75837]: DEBUG cinder.volume.drivers.lvm [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Updating volume stats {{(pid=75837) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 15:02:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:51 devstack sudo[78570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:02:51 devstack sudo[78570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:51 devstack sudo[78570]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:51 devstack sudo[78574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:02:51 devstack sudo[78574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:52 devstack sudo[78574]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:52 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:52 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:52 devstack sudo[78577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:02:52 devstack sudo[78577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:53 devstack sudo[78577]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:02:53 devstack sudo[78580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:02:53 devstack sudo[78580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:02:53 devstack sudo[78580]: pam_unix(sudo:session): session closed for user root Jul 09 15:02:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:02:53 devstack cinder-volume[75837]: DEBUG cinder.manager [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Notifying Schedulers of capabilities ... {{(pid=75837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:02:53 devstack cinder-volume[75837]: DEBUG oslo_service.periodic_task [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running periodic task VolumeManager._thread_info {{(pid=75837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:02:53 devstack cinder-volume[75837]: DEBUG cinder.volume.manager [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] thread count: 6 {{(pid=75837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:02:53 devstack cinder-volume[75837]: DEBUG cinder.volume.manager [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] thread info: [<_MainThread(MainThread, started 132199958204544)>, , , , , ] {{(pid=75837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:03:51 devstack cinder-volume[75837]: DEBUG oslo_service.periodic_task [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:03:51 devstack cinder-volume[75837]: DEBUG cinder.volume.drivers.lvm [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Updating volume stats {{(pid=75837) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 15:03:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:51 devstack sudo[81940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:03:51 devstack sudo[81940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:51 devstack sudo[81940]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:51 devstack sudo[81944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:03:51 devstack sudo[81944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:52 devstack sudo[81944]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:52 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:52 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:52 devstack sudo[81947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:03:52 devstack sudo[81947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:53 devstack sudo[81947]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:03:53 devstack sudo[81950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:03:53 devstack sudo[81950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:03:53 devstack sudo[81950]: pam_unix(sudo:session): session closed for user root Jul 09 15:03:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:03:53 devstack cinder-volume[75837]: DEBUG cinder.manager [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Notifying Schedulers of capabilities ... {{(pid=75837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:04:18 devstack cinder-volume[75837]: DEBUG dbcounter [-] [75837] Writing DB stats cinder:SELECT=1 {{(pid=75837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:04:18 devstack cinder-volume[75837]: DEBUG dbcounter [-] [75837] Writing DB stats cinder:UPDATE=1 {{(pid=75837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:04:51 devstack cinder-volume[75837]: DEBUG oslo_service.periodic_task [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running periodic task VolumeManager._thread_info {{(pid=75837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:04:51 devstack cinder-volume[75837]: DEBUG cinder.volume.manager [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] thread count: 6 {{(pid=75837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:04:51 devstack cinder-volume[75837]: DEBUG cinder.volume.manager [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] thread info: [<_MainThread(MainThread, started 132199958204544)>, , , , , ] {{(pid=75837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:05:51 devstack cinder-volume[75837]: DEBUG oslo_service.periodic_task [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:05:51 devstack cinder-volume[75837]: DEBUG cinder.volume.drivers.lvm [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Updating volume stats {{(pid=75837) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 15:05:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:51 devstack sudo[85048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 15:05:51 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:51 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:51 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:51 devstack sudo[85053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:05:51 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:52 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:52 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:52 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:52 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 15:05:52 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:53 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:05:53 devstack sudo[85084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 15:05:53 devstack sudo[85084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:05:53 devstack sudo[85084]: pam_unix(sudo:session): session closed for user root Jul 09 15:05:53 devstack cinder-volume[75837]: DEBUG oslo_concurrency.processutils [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:05:53 devstack cinder-volume[75837]: DEBUG cinder.manager [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Notifying Schedulers of capabilities ... {{(pid=75837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:05:53 devstack cinder-volume[75837]: DEBUG oslo_service.periodic_task [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] Running periodic task VolumeManager._thread_info {{(pid=75837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:05:53 devstack cinder-volume[75837]: DEBUG cinder.volume.manager [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] thread count: 6 {{(pid=75837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:05:53 devstack cinder-volume[75837]: DEBUG cinder.volume.manager [None req-f6f8b8ae-6237-4c73-9e0b-8cebfaf60d1a None None] thread info: [<_MainThread(MainThread, started 132199958204544)>, , , , , ] {{(pid=75837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:06:18 devstack cinder-volume[75837]: DEBUG dbcounter [-] [75837] Writing DB stats cinder:SELECT=1 {{(pid=75837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:06:18 devstack cinder-volume[75837]: DEBUG dbcounter [-] [75837] Writing DB stats cinder:UPDATE=1 {{(pid=75837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:06:28 devstack cinder-volume[75678]: INFO oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Caught SIGTERM, stopping children Jul 09 15:06:28 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Acquiring lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:06:28 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Acquired lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:06:28 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Releasing lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:06:28 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Stop services. {{(pid=75678) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 15:06:28 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Killing children. {{(pid=75678) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 15:06:28 devstack cinder-volume[75678]: INFO oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Waiting on 1 children to exit Jul 09 15:06:30 devstack cinder-volume[75837]: DEBUG oslo_concurrency.lockutils [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Acquiring lock "singleton_lock" {{(pid=75837) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:06:30 devstack cinder-volume[75837]: DEBUG oslo_concurrency.lockutils [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Acquired lock "singleton_lock" {{(pid=75837) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:06:30 devstack cinder-volume[75837]: DEBUG oslo_concurrency.lockutils [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Releasing lock "singleton_lock" {{(pid=75837) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:06:30 devstack cinder-volume[75837]: WARNING amqp [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 15:06:30 devstack cinder-volume[75837]: WARNING amqp [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 15:06:30 devstack cinder-volume[75678]: INFO oslo_service.backend._eventlet.service [None req-85c78661-9a64-4743-8df1-b7c658b0c5ff None None] Child 75837 exited with status 0 Jul 09 15:06:30 devstack cinder-volume[85922]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 15:06:30 devstack cinder-volume[85922]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 15:06:30 devstack cinder-volume[85922]: we strongly recommend against using it for new projects. Jul 09 15:06:30 devstack cinder-volume[85922]: If you are already using Eventlet, we recommend migrating to a different Jul 09 15:06:30 devstack cinder-volume[85922]: framework. For more detail see Jul 09 15:06:30 devstack cinder-volume[85922]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 15:06:30 devstack cinder-volume[85922]: import eventlet # noqa Jul 09 15:06:32 devstack cinder-volume[85922]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:06:32 devstack cinder-volume[85922]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:06:32 devstack cinder-volume[85922]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:06:33 devstack cinder-volume[85922]: INFO dbcounter [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Registered counter for database cinder Jul 09 15:06:33 devstack cinder-volume[85922]: DEBUG oslo_db.sqlalchemy.engines [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85922) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:06:33 devstack cinder-volume[85922]: DEBUG dbcounter [-] [85922] Writer thread running {{(pid=85922) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 15:06:33 devstack cinder-volume[85922]: INFO cinder.rpc [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 15:06:33 devstack cinder-volume[85922]: INFO cinder.rpc [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_db.sqlalchemy.engines [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85922) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:06:34 devstack cinder-volume[85922]: INFO cinder.volume.manager [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Determined volume DB was empty at startup. Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG cinder.volume.manager [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85922) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 15:06:34 devstack cinder-volume[85922]: INFO cinder.volume.manager [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 15:06:34 devstack cinder-volume[85922]: WARNING stevedore.named [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 15:06:34 devstack cinder-volume[85922]: WARNING castellan.key_manager [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:06:34 devstack cinder-volume[85922]: WARNING cinder.keymgr.conf_key_mgr [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:06:34 devstack cinder-volume[85922]: INFO cinder.volume.manager [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_db.sqlalchemy.engines [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85922) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:06:34 devstack cinder-volume[85922]: INFO oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Starting 1 workers Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Started child 86139 {{(pid=85922) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Full set of CONF: {{(pid=85922) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] ******************************************************************************** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Configuration options gathered from: {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] ================================================================================ {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] allow_availability_zone_fallback = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] allow_compression_on_image_upload = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] allowed_direct_url_schemes = [] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] api_rate_limit = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] auth_strategy = keystone {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_availability_zone = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_host = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_name = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_stats_polling_interval = 60 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[86139]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backup_api_class = cinder.backup.api.API {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backup_name_template = backup-%s {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backup_use_same_host = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backup_use_temp_snapshot = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] chap_password = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] chap_username = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cinder_internal_tenant_project_id = 974159a544f94ba3bdf4a12e5096590e {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cinder_internal_tenant_user_id = 6389a917d4ee453684c016e8ce8a31e4 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cluster = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] compression_format = gzip {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] compute_api_class = cinder.compute.nova.API {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] config_dir = [] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] config_source = [] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] control_exchange = openstack {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] debug = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] default_availability_zone = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] default_group_type = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] default_volume_type = QuobyteHD {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] disk_geometry = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] driver_client_cert = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] driver_client_cert_key = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] driver_data_namespace = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] driver_ssl_cert_path = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] driver_ssl_cert_verify = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] driver_use_ssl = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] enable_new_services = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] enable_unsupported_driver = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] enabled_backends = ['QuobyteHD'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] enforce_multipath_for_image_xfer = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] filter_function = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance_api_insecure = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance_api_servers = ['http://192.168.122.104/image'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance_api_ssl_compression = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance_ca_certificates_file = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance_catalog_info = image:glance:publicURL {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance_certfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance_keyfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance_num_retries = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance_request_timeout = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] goodness_function = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] graceful_shutdown_timeout = 5 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] group_api_class = cinder.group.api.API {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] host = devstack {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] image_compress_on_upload = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] image_conversion_address_space_limit = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] image_conversion_cpu_limit = 60 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] image_conversion_disable = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] image_upload_use_cinder_backend = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] image_upload_use_internal_tenant = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] image_volume_cache_enabled = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] image_volume_cache_max_count = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] image_volume_cache_max_size_gb = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] init_host_max_objects_retrieval = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] instance_format = [instance: %(uuid)s] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] iscsi_target_flags = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] iscsi_write_cache = on {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] iser_helper = tgtadm {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] iser_ip_address = 192.168.122.104 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] iser_port = 3260 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] log_color = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] log_config_append = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] log_dir = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] log_file = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] log_options = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] log_rotate_interval = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] log_rotate_interval_type = days {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] log_rotation_type = none {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] max_age = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] max_logfile_count = 30 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] max_logfile_size_mb = 200 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] max_over_subscription_ratio = 20.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] message_reap_interval = 86400 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] message_ttl = 2592000 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] migration_create_volume_timeout_secs = 300 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] monkey_patch = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] monkey_patch_modules = [] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] my_ip = 192.168.122.104 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] no_snapshot_gb_quota = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] num_iser_scan_tries = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] num_shell_tries = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] num_volume_device_scan_tries = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] nvmeof_conn_info_version = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] nvmet_ns_id = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] nvmet_port_id = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] osapi_max_limit = 1000 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] osapi_volume_ext_list = [] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] osapi_volume_listen_port = 8776 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] osapi_volume_use_ssl = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] osapi_volume_workers = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] per_volume_size_limit = -1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] periodic_fuzzy_delay = 60 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] periodic_interval = 60 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] public_endpoint = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] publish_errors = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] quota_backup_gigabytes = 1000 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] quota_backups = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] quota_gigabytes = 1000 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] quota_groups = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] quota_snapshots = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] quota_volumes = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] rate_limit_burst = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] rate_limit_except_level = CRITICAL {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] rate_limit_interval = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] reinit_driver_count = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] replication_device = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] report_discard_supported = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] report_interval = 120 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] reservation_clean_interval = 86400 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] reservation_expire = 86400 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] reserved_image_namespaces = [] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[86139]: INFO cinder.volume.manager [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] reserved_percentage = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[86139]: DEBUG cinder.volume.drivers.remotefs [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86139) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] rpc_response_timeout = 120 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] run_external_periodic_tasks = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] scst_target_driver = iscsi {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] scst_target_iqn_name = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_down_time = 720 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] shell_completion = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] snapshot_name_template = snapshot-%s {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] split_loggers = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] state_path = /opt/stack/data/cinder {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] storage_availability_zone = nova {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] storage_protocol = iSCSI {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] syslog_log_facility = LOG_USER {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] target_helper = lioadm {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] target_ip_address = 192.168.122.104 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] target_port = 3260 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] target_protocol = iscsi {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] target_secondary_ip_addresses = [] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] trace_flags = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] transport_url = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] until_refresh = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] use_chap_auth = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] use_default_quota_class = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] use_journal = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] use_json = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] use_multipath_for_image_xfer = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] use_stderr = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] use_syslog = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] verify_glance_signatures = enabled {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_api_class = cinder.volume.api.API {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_backend_name = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_clear = zero {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_clear_ionice = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_clear_size = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_copy_bps_limit = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_dd_blocksize = 1M {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_name_template = volume-%s {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_service_inithost_offload = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volume_usage_audit_period = month {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] zoning_mode = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_concurrency.disable_process_locking = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.auth_section = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.auth_type = password {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.auth_version = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.cache = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.certfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.include_service_catalog = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.insecure = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.interface = public {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.keyfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_password = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcache_username = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.region_name = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.service_type = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.104/identity {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.backend = dogpile.cache.null {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.backend_argument = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.backend_expiration_time = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.config_prefix = cache.oslo {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.debug_cache_backend = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.enable_retry_client = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.enable_socket_keepalive = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.enabled = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.expiration_time = 600 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.hashclient_retry_attempts = 2 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.memcache_dead_retry = 300 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.memcache_pool_maxsize = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.memcache_sasl_enabled = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.password = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.proxies = [] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.redis_db = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.redis_server = localhost:6379 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.retry_attempts = 2 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.retry_delay = 0.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.socket_keepalive_count = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.socket_keepalive_idle = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.socket_keepalive_interval = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.socket_timeout = 1.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.tls_allowed_ciphers = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.tls_cafile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.tls_certfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.tls_enabled = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.tls_keyfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cache.username = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] coordination.backend_url = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.asyncio_connection = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.asyncio_slave_connection = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.backend = sqlalchemy {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.connection = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.connection_debug = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.connection_parameters = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.connection_recycle_time = 3600 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.connection_trace = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.db_inc_retry_interval = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.db_max_retries = 20 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.db_max_retry_interval = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.db_retry_interval = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.max_overflow = 50 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.max_pool_size = 5 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.max_retries = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.mysql_wsrep_sync_wait = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.pool_timeout = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.retry_interval = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.slave_connection = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.sqlite_synchronous = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.synchronous_reader = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] database.use_db_reconnect = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.connection_string = messaging:// {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.enabled = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.es_doc_type = notification {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.es_scroll_size = 10000 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.es_scroll_time = 2m {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.filter_error_trace = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.hmac_keys = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.sentinel_service_name = mymaster {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.socket_timeout = 0.1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.trace_requests = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler.trace_sqlalchemy = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler_jaeger.process_tags = {} {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler_jaeger.service_name_prefix = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] profiler_otlp.service_name_prefix = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.enforce_new_defaults = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.enforce_scope = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.policy_default_rule = default {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.policy_file = policy.yaml {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] privsep_osbrick.group = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] privsep_osbrick.helper_command = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] privsep_osbrick.user = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cinder_sys_admin.group = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cinder_sys_admin.helper_command = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] cinder_sys_admin.user = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_user.auth_section = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_user.auth_type = password {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_user.cafile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_user.certfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_user.collect_timing = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_user.insecure = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_user.keyfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_user.send_service_user_token = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_user.split_loggers = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] service_user.timeout = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance.auth_section = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance.auth_type = password {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance.certfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance.collect_timing = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance.insecure = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance.keyfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance.region_name = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance.split_loggers = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] glance.timeout = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.backend_availability_zone = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.chap_password = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.chap_username = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.disk_geometry = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.driver_client_cert = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.driver_client_cert_key = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.driver_data_namespace = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.driver_use_ssl = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.extra_capabilities = {} {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.filter_function = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.goodness_function = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.iscsi_target_flags = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.iscsi_write_cache = on {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.iser_helper = tgtadm {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.iser_ip_address = 192.168.122.104 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.iser_port = 3260 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nas_host = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nas_login = admin {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nas_mount_options = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nas_password = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nas_private_key = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nas_share_path = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.num_shell_tries = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.quobyte_volume_url = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.replication_device = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.report_discard_supported = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.reserved_percentage = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.target_helper = tgtadm {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.target_ip_address = 192.168.122.104 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.target_port = 3260 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.target_protocol = iscsi {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.trace_flags = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.unique_fqdn_network = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.use_chap_auth = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.volume_backend_name = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.volume_clear = zero {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.volume_clear_ionice = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.volume_clear_size = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_reports.file_event_handler = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_reports.log_dir = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.backend_availability_zone = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.backend_host = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.chap_password = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.chap_username = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.chiscsi_conf = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.disk_geometry = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.driver_client_cert = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.driver_data_namespace = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.driver_use_ssl = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.extra_capabilities = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.filter_function = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.goodness_function = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.iser_helper = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.iser_ip_address = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.iser_port = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.iser_target_prefix = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nas_host = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nas_login = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nas_mount_options = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nas_password = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nas_private_key = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nas_share_path = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nas_ssh_port = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.num_shell_tries = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.nvmet_port_id = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.replication_device = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.report_discard_supported = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.reserved_percentage = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.scst_target_driver = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.storage_protocol = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.target_helper = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.target_ip_address = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.target_port = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.target_prefix = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.target_protocol = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.trace_flags = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.use_chap_auth = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.volume_clear = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.volume_clear_size = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] QuobyteHD.volumes_dir = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.ssl = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[86139]: DEBUG cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86139) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 15:06:34 devstack cinder-volume[86139]: WARNING cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 15:06:34 devstack cinder-volume[86139]: WARNING cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_notifications.driver = [] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_notifications.retry = -1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Running cmd (subprocess): mount.quobyte {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] key_manager.fixed_key = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.barbican_api_version = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.barbican_endpoint = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.barbican_endpoint_type = public {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.barbican_region_name = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.cafile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.certfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.collect_timing = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.insecure = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.keyfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.number_of_retries = 60 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.retry_delay = 1 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.send_service_user_token = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.split_loggers = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.timeout = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.verify_ssl = True {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican.verify_ssl_path = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican_service_user.auth_section = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican_service_user.auth_type = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican_service_user.cafile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican_service_user.certfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican_service_user.collect_timing = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican_service_user.insecure = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican_service_user.keyfile = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican_service_user.split_loggers = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] barbican_service_user.timeout = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.approle_role_id = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.approle_secret_id = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.kv_mountpoint = secret {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.kv_path = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.kv_version = 2 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.namespace = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.root_token_id = **** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.ssl_ca_crt_file = None {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.timeout = 60.0 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.use_ssl = False {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:34 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] ******************************************************************************** {{(pid=85922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 15:06:34 devstack quobyte-client[86143]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 15:06:34 devstack quobyte-client[86143]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 15:06:34 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:34 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:34 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:34 devstack cinder-volume[86139]: DEBUG cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:34 devstack cinder-volume[86139]: INFO cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b ... Jul 09 15:06:34 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d -c /etc/quobyte/client-cinder.cfg {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:34 devstack sudo[86149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d -c /etc/quobyte/client-cinder.cfg Jul 09 15:06:34 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:35 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:35 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.818s {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:35 devstack cinder-volume[86139]: INFO cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b succeeded Jul 09 15:06:35 devstack cinder-volume[86139]: DEBUG cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:35 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.834s {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:35 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:35 devstack sudo[86242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:06:35 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:36 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.688s {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:36 devstack cinder-volume[86139]: INFO cinder.volume.driver [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG cinder.volume.driver [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7570343017578, 'free_capacity_gb': 1775.7570343017578, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86139) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG dbcounter [-] [86139] Writer thread running {{(pid=86139) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG cinder.db.api [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Building query based on filter {{(pid=86139) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG cinder.image.image_utils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86139) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 15:06:36 devstack cinder-volume[86139]: INFO cinder.keymgr.migration [None req-e927116c-22ae-41f6-841d-c648ccad326f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:36 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:06:36 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:36 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.630s {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:36 devstack cinder-volume[86139]: DEBUG cinder.manager [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Notifying Schedulers of capabilities ... {{(pid=86139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:06:37 devstack cinder-volume[86139]: INFO cinder.volume.manager [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Driver initialization completed successfully. Jul 09 15:06:37 devstack cinder-volume[86139]: INFO cinder.manager [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Initiating service 3 cleanup Jul 09 15:06:37 devstack cinder-volume[86139]: INFO cinder.manager [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Service 3 cleanup completed. Jul 09 15:06:37 devstack cinder-volume[86139]: DEBUG cinder.service [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Creating RPC server for service cinder-volume {{(pid=86139) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 15:06:37 devstack cinder-volume[86139]: DEBUG cinder.service [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86139) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 15:06:37 devstack cinder-volume[86139]: INFO cinder.volume.manager [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 15:06:37 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:37 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:37 devstack cinder-volume[86139]: DEBUG cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:37 devstack cinder-volume[86139]: DEBUG cinder.volume.drivers.quobyte [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:37 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:37 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:37 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:06:37 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:38 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:38 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.778s {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:38 devstack cinder-volume[86139]: INFO cinder.volume.manager [None req-8fe12799-3fec-4b5b-ac46-7af6f2b8cac8 None None] Driver post RPC initialization completed successfully. Jul 09 15:06:42 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-78f8766b-da7b-4ccc-81ac-73231013b279 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:42 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-78f8766b-da7b-4ccc-81ac-73231013b279 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:42 devstack cinder-volume[86139]: DEBUG cinder.volume.drivers.quobyte [None req-78f8766b-da7b-4ccc-81ac-73231013b279 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86139) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:42 devstack cinder-volume[86139]: DEBUG cinder.volume.drivers.quobyte [None req-78f8766b-da7b-4ccc-81ac-73231013b279 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86139) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:42 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-78f8766b-da7b-4ccc-81ac-73231013b279 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86139) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:42 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-78f8766b-da7b-4ccc-81ac-73231013b279 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:42 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:06:42 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:42 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:42 devstack cinder-volume[86139]: DEBUG oslo_concurrency.processutils [None req-78f8766b-da7b-4ccc-81ac-73231013b279 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.698s {{(pid=86139) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:42 devstack cinder-volume[86139]: DEBUG cinder.manager [None req-78f8766b-da7b-4ccc-81ac-73231013b279 None None] Notifying Schedulers of capabilities ... {{(pid=86139) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:06:43 devstack cinder-volume[85922]: INFO oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Caught SIGTERM, stopping children Jul 09 15:06:43 devstack cinder-volume[85922]: DEBUG oslo_concurrency.lockutils [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Acquiring lock "singleton_lock" {{(pid=85922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:06:43 devstack cinder-volume[85922]: DEBUG oslo_concurrency.lockutils [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Acquired lock "singleton_lock" {{(pid=85922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:06:43 devstack cinder-volume[85922]: DEBUG oslo_concurrency.lockutils [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Releasing lock "singleton_lock" {{(pid=85922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:06:43 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Stop services. {{(pid=85922) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 15:06:43 devstack cinder-volume[85922]: DEBUG oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Killing children. {{(pid=85922) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 15:06:43 devstack cinder-volume[85922]: INFO oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Waiting on 1 children to exit Jul 09 15:06:45 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Acquiring lock "singleton_lock" {{(pid=86139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:06:45 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Acquired lock "singleton_lock" {{(pid=86139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:06:45 devstack cinder-volume[86139]: DEBUG oslo_concurrency.lockutils [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Releasing lock "singleton_lock" {{(pid=86139) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:06:45 devstack cinder-volume[86139]: WARNING amqp [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 15:06:45 devstack cinder-volume[86139]: WARNING amqp [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 15:06:45 devstack cinder-volume[85922]: INFO oslo_service.backend._eventlet.service [None req-f0a53700-bde9-449f-a90b-0b87ddc48903 None None] Child 86139 exited with status 0 Jul 09 15:06:45 devstack cinder-volume[86638]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 15:06:45 devstack cinder-volume[86638]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 15:06:45 devstack cinder-volume[86638]: we strongly recommend against using it for new projects. Jul 09 15:06:45 devstack cinder-volume[86638]: If you are already using Eventlet, we recommend migrating to a different Jul 09 15:06:45 devstack cinder-volume[86638]: framework. For more detail see Jul 09 15:06:45 devstack cinder-volume[86638]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 15:06:45 devstack cinder-volume[86638]: import eventlet # noqa Jul 09 15:06:48 devstack cinder-volume[86638]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 15:06:48 devstack cinder-volume[86638]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 15:06:48 devstack cinder-volume[86638]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 15:06:49 devstack cinder-volume[86638]: INFO dbcounter [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Registered counter for database cinder Jul 09 15:06:49 devstack cinder-volume[86638]: DEBUG oslo_db.sqlalchemy.engines [None req-90f1915a-15de-4924-883d-6004c0870811 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86638) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG dbcounter [-] [86638] Writer thread running {{(pid=86638) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 15:06:50 devstack cinder-volume[86638]: INFO cinder.rpc [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 15:06:50 devstack cinder-volume[86638]: INFO cinder.rpc [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_db.sqlalchemy.engines [None req-90f1915a-15de-4924-883d-6004c0870811 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86638) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:06:50 devstack cinder-volume[86638]: INFO cinder.volume.manager [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Determined volume DB was empty at startup. Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG cinder.volume.manager [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86638) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 15:06:50 devstack cinder-volume[86638]: WARNING stevedore.named [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 15:06:50 devstack cinder-volume[86638]: WARNING castellan.key_manager [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:06:50 devstack cinder-volume[86638]: WARNING cinder.keymgr.conf_key_mgr [None req-90f1915a-15de-4924-883d-6004c0870811 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 15:06:50 devstack cinder-volume[86638]: INFO cinder.volume.manager [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_db.sqlalchemy.engines [None req-90f1915a-15de-4924-883d-6004c0870811 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86638) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:06:50 devstack cinder-volume[86638]: INFO oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Starting 1 workers Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Started child 86916 {{(pid=86638) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Full set of CONF: {{(pid=86638) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] ******************************************************************************** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] Configuration options gathered from: {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] ================================================================================ {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] allow_availability_zone_fallback = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] allow_compression_on_image_upload = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] allowed_direct_url_schemes = [] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] api_rate_limit = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] auth_strategy = keystone {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_availability_zone = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_host = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_name = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_stats_polling_interval = 60 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backup_api_class = cinder.backup.api.API {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backup_name_template = backup-%s {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backup_use_same_host = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backup_use_temp_snapshot = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] chap_password = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] chap_username = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cinder_internal_tenant_project_id = 974159a544f94ba3bdf4a12e5096590e {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cinder_internal_tenant_user_id = 6389a917d4ee453684c016e8ce8a31e4 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cluster = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] compression_format = gzip {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] compute_api_class = cinder.compute.nova.API {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] config_dir = [] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86916]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] config_source = [] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] control_exchange = openstack {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] debug = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] default_availability_zone = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:50 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] default_group_type = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] default_volume_type = QuobyteHD {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] disk_geometry = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] driver_client_cert = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] driver_client_cert_key = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] driver_data_namespace = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] driver_ssl_cert_path = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] driver_ssl_cert_verify = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] driver_use_ssl = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] enable_new_services = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] enable_unsupported_driver = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] enabled_backends = ['QuobyteHD'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] enforce_multipath_for_image_xfer = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] filter_function = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance_api_insecure = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance_api_servers = ['http://192.168.122.104/image'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance_api_ssl_compression = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance_ca_certificates_file = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance_catalog_info = image:glance:publicURL {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance_certfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance_keyfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance_num_retries = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance_request_timeout = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] goodness_function = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] graceful_shutdown_timeout = 5 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] group_api_class = cinder.group.api.API {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] host = devstack {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] image_compress_on_upload = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] image_conversion_address_space_limit = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] image_conversion_cpu_limit = 60 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] image_conversion_disable = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] image_upload_use_cinder_backend = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] image_upload_use_internal_tenant = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] image_volume_cache_enabled = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] image_volume_cache_max_count = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] image_volume_cache_max_size_gb = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] init_host_max_objects_retrieval = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] instance_format = [instance: %(uuid)s] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] iscsi_target_flags = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] iscsi_write_cache = on {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] iser_helper = tgtadm {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] iser_ip_address = 192.168.122.104 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] iser_port = 3260 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] log_color = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] log_config_append = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] log_dir = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] log_file = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] log_options = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] log_rotate_interval = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] log_rotate_interval_type = days {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] log_rotation_type = none {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] max_age = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] max_logfile_count = 30 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] max_logfile_size_mb = 200 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] max_over_subscription_ratio = 20.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] message_reap_interval = 86400 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 15:06:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86916) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] message_ttl = 2592000 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] migration_create_volume_timeout_secs = 300 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] monkey_patch = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] monkey_patch_modules = [] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] my_ip = 192.168.122.104 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] no_snapshot_gb_quota = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] num_iser_scan_tries = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] num_shell_tries = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] num_volume_device_scan_tries = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] nvmeof_conn_info_version = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] nvmet_ns_id = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] nvmet_port_id = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] osapi_max_limit = 1000 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] osapi_volume_ext_list = [] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] osapi_volume_listen_port = 8776 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] osapi_volume_use_ssl = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] osapi_volume_workers = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] per_volume_size_limit = -1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] periodic_fuzzy_delay = 60 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] periodic_interval = 60 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] public_endpoint = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] publish_errors = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] quota_backup_gigabytes = 1000 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] quota_backups = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] quota_gigabytes = 1000 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] quota_groups = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] quota_snapshots = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] quota_volumes = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] rate_limit_burst = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] rate_limit_except_level = CRITICAL {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] rate_limit_interval = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] reinit_driver_count = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] replication_device = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] report_discard_supported = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] report_interval = 120 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] reservation_clean_interval = 86400 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] reservation_expire = 86400 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] reserved_image_namespaces = [] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] reserved_percentage = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] rpc_response_timeout = 120 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] run_external_periodic_tasks = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] scst_target_driver = iscsi {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] scst_target_iqn_name = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_down_time = 720 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] shell_completion = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] snapshot_name_template = snapshot-%s {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] split_loggers = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] state_path = /opt/stack/data/cinder {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] storage_availability_zone = nova {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] storage_protocol = iSCSI {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] syslog_log_facility = LOG_USER {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] target_helper = lioadm {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] target_ip_address = 192.168.122.104 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] target_port = 3260 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] target_protocol = iscsi {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] target_secondary_ip_addresses = [] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] trace_flags = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] transport_url = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] until_refresh = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] use_chap_auth = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] use_default_quota_class = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] use_journal = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] use_json = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] use_multipath_for_image_xfer = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] use_stderr = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] use_syslog = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] verify_glance_signatures = enabled {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_api_class = cinder.volume.api.API {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_backend_name = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_clear = zero {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_clear_ionice = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_clear_size = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_copy_bps_limit = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_dd_blocksize = 1M {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_name_template = volume-%s {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_service_inithost_offload = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volume_usage_audit_period = month {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] zoning_mode = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_concurrency.disable_process_locking = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86916) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 15:06:51 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.quobyte [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 15:06:51 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.quobyte [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.auth_section = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.auth_type = password {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.auth_version = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.cache = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.certfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.include_service_catalog = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.insecure = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Running cmd (subprocess): mount.quobyte {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.interface = public {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.keyfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_password = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcache_username = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.region_name = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.service_type = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.104/identity {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.backend = dogpile.cache.null {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.backend_argument = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.backend_expiration_time = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.config_prefix = cache.oslo {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.debug_cache_backend = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.enable_retry_client = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.enable_socket_keepalive = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.enabled = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.expiration_time = 600 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.hashclient_retry_attempts = 2 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.memcache_dead_retry = 300 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.memcache_pool_maxsize = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.memcache_sasl_enabled = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.password = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.proxies = [] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.redis_db = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.redis_server = localhost:6379 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.retry_attempts = 2 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.retry_delay = 0.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.socket_keepalive_count = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.socket_keepalive_idle = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.socket_keepalive_interval = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.socket_timeout = 1.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.tls_allowed_ciphers = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.tls_cafile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.tls_certfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.tls_enabled = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.tls_keyfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cache.username = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] coordination.backend_url = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.asyncio_connection = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.asyncio_slave_connection = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.backend = sqlalchemy {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.connection = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.connection_debug = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.connection_parameters = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.connection_recycle_time = 3600 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.connection_trace = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.db_inc_retry_interval = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.db_max_retries = 20 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.db_max_retry_interval = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.db_retry_interval = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.max_overflow = 50 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.max_pool_size = 5 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.max_retries = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.mysql_wsrep_sync_wait = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.pool_timeout = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.retry_interval = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.slave_connection = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.sqlite_synchronous = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.synchronous_reader = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] database.use_db_reconnect = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.connection_string = messaging:// {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.enabled = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.es_doc_type = notification {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.es_scroll_size = 10000 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.es_scroll_time = 2m {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.filter_error_trace = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.hmac_keys = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.sentinel_service_name = mymaster {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.socket_timeout = 0.1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.trace_requests = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler.trace_sqlalchemy = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler_jaeger.process_tags = {} {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler_jaeger.service_name_prefix = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] profiler_otlp.service_name_prefix = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.enforce_new_defaults = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.enforce_scope = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.policy_default_rule = default {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.policy_file = policy.yaml {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] privsep_osbrick.group = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] privsep_osbrick.helper_command = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] privsep_osbrick.user = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cinder_sys_admin.group = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cinder_sys_admin.helper_command = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] cinder_sys_admin.user = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_user.auth_section = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_user.auth_type = password {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_user.cafile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_user.certfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_user.collect_timing = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_user.insecure = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_user.keyfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_user.send_service_user_token = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_user.split_loggers = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] service_user.timeout = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance.auth_section = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance.auth_type = password {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance.certfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance.collect_timing = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance.insecure = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance.keyfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance.region_name = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance.split_loggers = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] glance.timeout = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.backend_availability_zone = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.chap_password = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.chap_username = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.disk_geometry = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.driver_client_cert = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.driver_client_cert_key = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.driver_data_namespace = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.driver_use_ssl = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.extra_capabilities = {} {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.filter_function = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.goodness_function = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.iscsi_target_flags = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.iscsi_write_cache = on {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.iser_helper = tgtadm {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.iser_ip_address = 192.168.122.104 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.iser_port = 3260 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nas_host = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nas_login = admin {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nas_mount_options = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nas_password = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nas_private_key = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nas_share_path = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.num_shell_tries = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.quobyte_volume_url = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.replication_device = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.report_discard_supported = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.reserved_percentage = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.target_helper = tgtadm {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.target_ip_address = 192.168.122.104 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.target_port = 3260 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.target_protocol = iscsi {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.trace_flags = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.unique_fqdn_network = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.use_chap_auth = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.volume_backend_name = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.volume_clear = zero {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.volume_clear_ionice = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.volume_clear_size = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_reports.file_event_handler = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_reports.log_dir = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.backend_availability_zone = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.backend_host = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.chap_password = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.chap_username = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.chiscsi_conf = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.disk_geometry = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.driver_client_cert = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.driver_data_namespace = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] CMD "mount.quobyte" returned: 1 in 0.115s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.driver_use_ssl = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.extra_capabilities = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.filter_function = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.goodness_function = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.iser_helper = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.iser_ip_address = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.iser_port = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.iser_target_prefix = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nas_host = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nas_login = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nas_mount_options = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nas_password = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nas_private_key = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nas_share_path = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nas_ssh_port = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.num_shell_tries = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.nvmet_port_id = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.replication_device = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.report_discard_supported = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.reserved_percentage = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.scst_target_driver = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.storage_protocol = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.target_helper = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.target_ip_address = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.target_port = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.target_prefix = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.target_protocol = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.trace_flags = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.use_chap_auth = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.volume_clear = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.volume_clear_size = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] QuobyteHD.volumes_dir = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.ssl = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_notifications.driver = [] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_notifications.retry = -1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] key_manager.fixed_key = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.barbican_api_version = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.barbican_endpoint = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.barbican_endpoint_type = public {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.barbican_region_name = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.cafile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.certfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.collect_timing = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.insecure = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.keyfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.number_of_retries = 60 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.retry_delay = 1 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.send_service_user_token = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.split_loggers = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.timeout = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.verify_ssl = True {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican.verify_ssl_path = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican_service_user.auth_section = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican_service_user.auth_type = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican_service_user.cafile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican_service_user.certfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican_service_user.collect_timing = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican_service_user.insecure = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican_service_user.keyfile = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican_service_user.split_loggers = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] barbican_service_user.timeout = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.approle_role_id = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.approle_secret_id = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.kv_mountpoint = secret {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.kv_path = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.kv_version = 2 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.namespace = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.root_token_id = **** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.ssl_ca_crt_file = None {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.timeout = 60.0 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.use_ssl = False {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 15:06:51 devstack cinder-volume[86638]: DEBUG oslo_service.backend._eventlet.service [None req-90f1915a-15de-4924-883d-6004c0870811 None None] ******************************************************************************** {{(pid=86638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 15:06:52 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.955s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:52 devstack cinder-volume[86916]: INFO cinder.volume.driver [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG cinder.volume.driver [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755428314209, 'free_capacity_gb': 1775.755428314209, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG oslo_db.sqlalchemy.engines [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writer thread running {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG cinder.db.api [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Building query based on filter {{(pid=86916) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86916) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:52 devstack cinder-volume[86916]: INFO cinder.keymgr.migration [None req-15043a72-f5f8-4f2c-a307-52b7abc1336b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 15:06:52 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:06:52 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:52 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.617s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:06:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Driver initialization completed successfully. Jul 09 15:06:52 devstack cinder-volume[86916]: INFO cinder.manager [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Initiating service 3 cleanup Jul 09 15:06:52 devstack cinder-volume[86916]: INFO cinder.manager [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Service 3 cleanup completed. Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG cinder.service [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Creating RPC server for service cinder-volume {{(pid=86916) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 15:06:52 devstack cinder-volume[86916]: DEBUG cinder.service [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86916) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 15:06:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 15:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:06:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:06:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:06:53 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:06:53 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:06:53 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Jul 09 15:06:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.658s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:06:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9e8e2e4c-ca44-4892-8c0a-93a41242a031 None None] Driver post RPC initialization completed successfully. Jul 09 15:07:00 devstack cinder-volume[86638]: DEBUG dbcounter [-] [86638] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86638) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:07:02 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:07:03 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:07:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 6 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:07:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Flow 'volume_create_manager' (25144bcf-7a1c-41b3-958a-53b048f415d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9f30d5-ba3a-427a-bce6-ddc66bb143cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9f30d5-ba3a-427a-bce6-ddc66bb143cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-591208194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032da5a6-6e34-41c9-845b-8c1bd2079f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8f96d38024ce1b5e01cffbc85c451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:07:52Z,use_quota=True,user_id='e47227070c89437792482eb968468cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3981e0e4-71f1-4b0c-8aa5-386987a321d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3981e0e4-71f1-4b0c-8aa5-386987a321d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5232d4-c84f-4e85-b566-7c9d36230bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5232d4-c84f-4e85-b566-7c9d36230bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032da5a6-6e34-41c9-845b-8c1bd2079f82', 'volume_name': 'volume-032da5a6-6e34-41c9-845b-8c1bd2079f82', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9f970a-79ca-4e0c-8e9d-9b6d128d9e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9f970a-79ca-4e0c-8e9d-9b6d128d9e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b626cf4a-223f-4cff-868c-d89518f49dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Volume 032da5a6-6e34-41c9-845b-8c1bd2079f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032da5a6-6e34-41c9-845b-8c1bd2079f82', 'volume_size': 1} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-591208194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032da5a6-6e34-41c9-845b-8c1bd2079f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b8f96d38024ce1b5e01cffbc85c451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:07:52Z,use_quota=True,user_id='e47227070c89437792482eb968468cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Creating volume 032da5a6-6e34-41c9-845b-8c1bd2079f82 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:07:51 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:07:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:51 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 1073741824 Jul 09 15:07:51 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:53 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 1073741824" returned: 0 in 1.532s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:07:53 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 Jul 09 15:07:53 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:07:54 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Jul 09 15:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82" returned: 0 in 1.465s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:07:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] <== create_volume: return (3096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:07:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.098s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:07:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b626cf4a-223f-4cff-868c-d89518f49dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032da5a6-6e34-41c9-845b-8c1bd2079f82', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e1b5c4-ee81-456f-819f-0aa77e690869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:07:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Volume volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 (032da5a6-6e34-41c9-845b-8c1bd2079f82): created successfully Jul 09 15:07:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e1b5c4-ee81-456f-819f-0aa77e690869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:07:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Flow 'volume_create_manager' (25144bcf-7a1c-41b3-958a-53b048f415d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:07:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-69c93ac7-14ca-4d41-95a8-bd7207ca7af5 tempest-TaggedAttachmentsTest-1897912091 None] Created volume successfully. Jul 09 15:08:05 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:08:05 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Flow 'volume_create_manager' (5abcd4bd-782c-4d41-89e1-ec6dd01ba672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256f13f3-461e-4398-a100-63d73dd2c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256f13f3-461e-4398-a100-63d73dd2c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1083498570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f840264e-28aa-4ed3-a619-9dbb03437993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb743bf50a54b90b22a105def845a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:08:07Z,use_quota=True,user_id='26774c794c4b4ef0ac63d46634372280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6743af-3523-4065-b81b-b0381569623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6743af-3523-4065-b81b-b0381569623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3183e293-8103-4024-adb3-bd081d308aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3183e293-8103-4024-adb3-bd081d308aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f840264e-28aa-4ed3-a619-9dbb03437993', 'volume_name': 'volume-f840264e-28aa-4ed3-a619-9dbb03437993', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfce156-2278-4c1b-a65b-7841c638913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfce156-2278-4c1b-a65b-7841c638913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347d8042-f992-4ad2-87d1-6df826edbbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Volume f840264e-28aa-4ed3-a619-9dbb03437993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f840264e-28aa-4ed3-a619-9dbb03437993', 'volume_size': 1} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1083498570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f840264e-28aa-4ed3-a619-9dbb03437993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb743bf50a54b90b22a105def845a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:08:07Z,use_quota=True,user_id='26774c794c4b4ef0ac63d46634372280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Creating volume f840264e-28aa-4ed3-a619-9dbb03437993 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:08:07 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:08:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:07 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 1073741824 Jul 09 15:08:07 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:09 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 1073741824" returned: 0 in 1.661s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:09 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 Jul 09 15:08:09 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:10 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993" returned: 0 in 1.538s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] <== create_volume: return (3279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:08:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.284s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347d8042-f992-4ad2-87d1-6df826edbbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f840264e-28aa-4ed3-a619-9dbb03437993', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0dedb4-7ffc-4a10-b04d-610b93306cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Volume volume-f840264e-28aa-4ed3-a619-9dbb03437993 (f840264e-28aa-4ed3-a619-9dbb03437993): created successfully Jul 09 15:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0dedb4-7ffc-4a10-b04d-610b93306cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Flow 'volume_create_manager' (5abcd4bd-782c-4d41-89e1-ec6dd01ba672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:08:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1c5a1984-f54b-418a-9f55-5ef4baa8108f tempest-DeleteServersTestJSON-118931345 None] Created volume successfully. Jul 09 15:08:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Flow 'volume_create_manager' (5e47e9e5-5943-4553-890d-f364479b0075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6f40e0-ec45-4c4f-b705-7e9b9a5a6fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6f40e0-ec45-4c4f-b705-7e9b9a5a6fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1714054212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c697223-1944-4963-8da4-4063ca881b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e30c416a5b4a54866a09805d6c209b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:08:15Z,use_quota=True,user_id='7aa736a9dc7b4878a8186701464ca4fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b02f7b-d555-4cfb-82f8-4cf656104eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b02f7b-d555-4cfb-82f8-4cf656104eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f7cb76-a98a-42d3-bc83-0bc05f2fe473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f7cb76-a98a-42d3-bc83-0bc05f2fe473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c697223-1944-4963-8da4-4063ca881b5a', 'volume_name': 'volume-3c697223-1944-4963-8da4-4063ca881b5a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cc661d-b55f-4ff1-a2bc-4f4da58bcda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cc661d-b55f-4ff1-a2bc-4f4da58bcda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513e84cb-b5a2-4e56-b0d6-9416f63b9f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Volume 3c697223-1944-4963-8da4-4063ca881b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c697223-1944-4963-8da4-4063ca881b5a', 'volume_size': 1} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1714054212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c697223-1944-4963-8da4-4063ca881b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e30c416a5b4a54866a09805d6c209b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:08:15Z,use_quota=True,user_id='7aa736a9dc7b4878a8186701464ca4fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Creating volume 3c697223-1944-4963-8da4-4063ca881b5a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:08:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:08:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:15 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a 1073741824 Jul 09 15:08:15 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:16 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a 1073741824" returned: 0 in 1.496s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:16 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a Jul 09 15:08:16 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:18 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a" returned: 0 in 2.018s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] <== create_volume: return (3664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:08:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.673s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513e84cb-b5a2-4e56-b0d6-9416f63b9f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c697223-1944-4963-8da4-4063ca881b5a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4b8209-a202-4943-aade-fb34bf41e79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:08:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Volume volume-3c697223-1944-4963-8da4-4063ca881b5a (3c697223-1944-4963-8da4-4063ca881b5a): created successfully Jul 09 15:08:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4b8209-a202-4943-aade-fb34bf41e79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:08:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Flow 'volume_create_manager' (5e47e9e5-5943-4553-890d-f364479b0075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:08:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d36377c8-3ff1-435f-b280-0c06c58fccdd tempest-VolumesAdminNegativeTest-1136728307 None] Created volume successfully. Jul 09 15:08:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Acquiring lock "cinder-3c697223-1944-4963-8da4-4063ca881b5a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Lock "cinder-3c697223-1944-4963-8da4-4063ca881b5a-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Acquiring lock "cinder-quobyte-3c697223-1944-4963-8da4-4063ca881b5a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Lock "cinder-quobyte-3c697223-1944-4963-8da4-4063ca881b5a" acquired by "delete_volume" :: waited 0.054s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:20 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9qxcawlu/privsep.sock'] Jul 09 15:08:20 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9qxcawlu/privsep.sock Jul 09 15:08:20 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:21 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 15:08:21 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 15:08:21 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 15:08:21 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 15:08:21 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 15:08:21 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 15:08:21 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 15:08:21 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 15:08:21 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 15:08:22 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 15:08:22 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 15:08:22 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 15:08:22 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 15:08:22 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 15:08:22 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 15:08:22 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 15:08:22 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 15:08:22 devstack cinder-volume[86916]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 15:08:23 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:23 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Spawned new privsep daemon via rootwrap Jul 09 15:08:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Accepted privsep connection to /tmp/tmp9qxcawlu/privsep.sock {{(pid=86916) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 15:08:23 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 15:08:23 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 15:08:23 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 15:08:23 devstack cinder-volume[86916]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87901 Jul 09 15:08:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0371eb-d326-472e-abf2-8681dac95368]: (2,) {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:23 devstack cinder-volume[86916]: WARNING py.warnings [req-462f761e-54a0-4a58-b525-b8f5aedd7857 req-2c65bb77-025c-4e9a-bc5e-81ce321a099d tempest-DeleteServersTestJSON-118931345 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 09 15:08:23 devstack cinder-volume[86916]: .first() Jul 09 15:08:23 devstack cinder-volume[86916]: Jul 09 15:08:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e49228-d29a-4c86-81a5-c7f6359ee1cb]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-462f761e-54a0-4a58-b525-b8f5aedd7857 req-2c65bb77-025c-4e9a-bc5e-81ce321a099d tempest-DeleteServersTestJSON-118931345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-462f761e-54a0-4a58-b525-b8f5aedd7857 req-2c65bb77-025c-4e9a-bc5e-81ce321a099d tempest-DeleteServersTestJSON-118931345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2f4c7f-280d-4653-8157-a2d2e10e4fa1]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-462f761e-54a0-4a58-b525-b8f5aedd7857 req-2c65bb77-025c-4e9a-bc5e-81ce321a099d tempest-DeleteServersTestJSON-118931345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:23 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a Jul 09 15:08:23 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:23 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 Jul 09 15:08:23 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:24 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-462f761e-54a0-4a58-b525-b8f5aedd7857 req-2c65bb77-025c-4e9a-bc5e-81ce321a099d tempest-DeleteServersTestJSON-118931345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993" returned: 0 in 1.169s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-462f761e-54a0-4a58-b525-b8f5aedd7857 req-2c65bb77-025c-4e9a-bc5e-81ce321a099d tempest-DeleteServersTestJSON-118931345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.207s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-462f761e-54a0-4a58-b525-b8f5aedd7857 req-2c65bb77-025c-4e9a-bc5e-81ce321a099d tempest-DeleteServersTestJSON-118931345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-f840264e-28aa-4ed3-a619-9dbb03437993', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a3b37a6-1cd2-4528-8488-4f5bbb91305c', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:08:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-462f761e-54a0-4a58-b525-b8f5aedd7857 req-2c65bb77-025c-4e9a-bc5e-81ce321a099d tempest-DeleteServersTestJSON-118931345 None] attachment_update completed successfully. Jul 09 15:08:25 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a" returned: 0 in 1.733s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:25 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a Jul 09 15:08:25 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:26 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3c697223-1944-4963-8da4-4063ca881b5a" returned: 0 in 1.302s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Lock "cinder-quobyte-3c697223-1944-4963-8da4-4063ca881b5a" released by "delete_volume" :: held 6.198s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:26 devstack cinder-volume[86916]: WARNING cinder.quota [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:08:26 devstack cinder-volume[86916]: WARNING cinder.quota [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:08:26 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Created reservations ['7cd1be33-deee-4bf7-992c-2a04d60ae7cc', 'f37204d4-153d-42d4-bf6d-e137b913dbcd', '28acc763-08c2-4aa5-8965-5b5d0ac08a7e', '91d48ddf-f4c9-4568-b2af-3d9075c8582d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:08:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:08:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:08:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:26 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:08:26 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:28 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 2.032s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:28 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:08:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Deleted volume successfully. Jul 09 15:08:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-96ea6b94-2cd2-41c5-99da-b801220e3251 tempest-VolumesAdminNegativeTest-1136728307 None] Lock "cinder-3c697223-1944-4963-8da4-4063ca881b5a-delete_volume" released by "delete_volume" :: held 8.698s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-f566dc70-e9b7-414a-bcf4-3771a0b2d77f req-33c910a3-145f-4901-9f7d-bdf192d89a3f tempest-DeleteServersTestJSON-118931345 None] Terminate volume connection completed successfully. Jul 09 15:08:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f566dc70-e9b7-414a-bcf4-3771a0b2d77f req-33c910a3-145f-4901-9f7d-bdf192d89a3f tempest-DeleteServersTestJSON-118931345 None] Deleting attachment 3a3b37a6-1cd2-4528-8488-4f5bbb91305c. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:08:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Acquiring lock "cinder-f840264e-28aa-4ed3-a619-9dbb03437993-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Lock "cinder-f840264e-28aa-4ed3-a619-9dbb03437993-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Acquiring lock "cinder-quobyte-f840264e-28aa-4ed3-a619-9dbb03437993" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:08:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Lock "cinder-quobyte-f840264e-28aa-4ed3-a619-9dbb03437993" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:08:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e531caee-4805-4848-83d0-e87d15a99475]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:08:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:39 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 Jul 09 15:08:39 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:40 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993" returned: 0 in 1.118s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:40 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993 Jul 09 15:08:40 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:41 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f840264e-28aa-4ed3-a619-9dbb03437993" returned: 0 in 0.732s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Lock "cinder-quobyte-f840264e-28aa-4ed3-a619-9dbb03437993" released by "delete_volume" :: held 1.906s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:41 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Created reservations ['314afbe7-511f-44f3-b9ec-d6e558a2f27e', 'c8c2ab67-8672-432b-b4c2-17595897bf3b', '7dc3aca7-53e0-4e8b-9b7c-9dcf718410c2', 'bcb617d3-f387-4c1a-a338-dce62e0488da'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:08:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:41 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:08:41 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:42 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.705s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:42 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:08:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Deleted volume successfully. Jul 09 15:08:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7c781b2b-83ab-4550-bf1e-2c1d825ae5d2 tempest-DeleteServersTestJSON-118931345 None] Lock "cinder-f840264e-28aa-4ed3-a619-9dbb03437993-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:08:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:08:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:08:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:08:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:08:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:08:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:08:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:08:47 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:08:47 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:08:48 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Jul 09 15:08:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.758s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:08:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:08:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:08:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:08:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:08:51 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=20,cinder:INSERT=6,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:08:52 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=27,cinder:SELECT=21,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:09:03 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:09:03 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:09:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-294aa8c8-d621-4999-88ac-3cb41f4ff0b2 req-51462259-321b-4b17-8ed4-a4de91af627f tempest-TaggedAttachmentsTest-1897912091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-294aa8c8-d621-4999-88ac-3cb41f4ff0b2 req-51462259-321b-4b17-8ed4-a4de91af627f tempest-TaggedAttachmentsTest-1897912091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e728dcb-fcd5-459a-ba7d-c73e2f1242dd]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:09:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-294aa8c8-d621-4999-88ac-3cb41f4ff0b2 req-51462259-321b-4b17-8ed4-a4de91af627f tempest-TaggedAttachmentsTest-1897912091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:11 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 Jul 09 15:09:11 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:12 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-294aa8c8-d621-4999-88ac-3cb41f4ff0b2 req-51462259-321b-4b17-8ed4-a4de91af627f tempest-TaggedAttachmentsTest-1897912091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82" returned: 0 in 0.941s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-294aa8c8-d621-4999-88ac-3cb41f4ff0b2 req-51462259-321b-4b17-8ed4-a4de91af627f tempest-TaggedAttachmentsTest-1897912091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.969s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-294aa8c8-d621-4999-88ac-3cb41f4ff0b2 req-51462259-321b-4b17-8ed4-a4de91af627f tempest-TaggedAttachmentsTest-1897912091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-032da5a6-6e34-41c9-845b-8c1bd2079f82', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '976b0ecd-de3c-4012-b95d-dd11e009dc9d', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:09:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-294aa8c8-d621-4999-88ac-3cb41f4ff0b2 req-51462259-321b-4b17-8ed4-a4de91af627f tempest-TaggedAttachmentsTest-1897912091 None] attachment_update completed successfully. Jul 09 15:09:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-b58dfcb6-d5c2-45d3-97c5-c9789e852639 req-f5d767b4-4dc1-4496-b1f6-2ae8c2b75578 tempest-TaggedAttachmentsTest-1897912091 None] Terminate volume connection completed successfully. Jul 09 15:09:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-b58dfcb6-d5c2-45d3-97c5-c9789e852639 req-f5d767b4-4dc1-4496-b1f6-2ae8c2b75578 tempest-TaggedAttachmentsTest-1897912091 None] Deleting attachment 976b0ecd-de3c-4012-b95d-dd11e009dc9d. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:09:30 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:09:30 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Flow 'volume_create_manager' (a93763a4-33a0-4c43-9e9d-30b23f938a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffeb032-bcc7-42db-982d-5b26563721c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffeb032-bcc7-42db-982d-5b26563721c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-412194038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a367d18b-87cd-4b65-82eb-6fcb272fc4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286b2e4580464c04a0c5d0cf7b1a41a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:46Z,use_quota=True,user_id='cded9df202134219ad10b1f8d4c4f687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d53da19-cafb-4ed8-8be9-f92b9b35d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d53da19-cafb-4ed8-8be9-f92b9b35d06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6792128-6f90-48bf-9768-fef4e18b3153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6792128-6f90-48bf-9768-fef4e18b3153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a367d18b-87cd-4b65-82eb-6fcb272fc4e8', 'volume_name': 'volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f8efe4-f1b7-4c1e-bc57-2173ab213fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f8efe4-f1b7-4c1e-bc57-2173ab213fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3708b9ba-36bb-4ac6-be76-8725c49de029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Volume a367d18b-87cd-4b65-82eb-6fcb272fc4e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8', 'volume_size': 1} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-412194038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a367d18b-87cd-4b65-82eb-6fcb272fc4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286b2e4580464c04a0c5d0cf7b1a41a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:46Z,use_quota=True,user_id='cded9df202134219ad10b1f8d4c4f687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Creating volume a367d18b-87cd-4b65-82eb-6fcb272fc4e8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:09:46 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:09:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:46 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8 1073741824 Jul 09 15:09:46 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:09:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:47 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:09:47 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:48 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8 1073741824" returned: 0 in 1.446s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:48 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8 Jul 09 15:09:48 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:48 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:09:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:09:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:09:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:09:49 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8" returned: 0 in 1.658s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] <== create_volume: return (3243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:09:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.251s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3708b9ba-36bb-4ac6-be76-8725c49de029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec08a1a-c276-4f0c-95e7-6037e50e0941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Volume volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8 (a367d18b-87cd-4b65-82eb-6fcb272fc4e8): created successfully Jul 09 15:09:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec08a1a-c276-4f0c-95e7-6037e50e0941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Flow 'volume_create_manager' (a93763a4-33a0-4c43-9e9d-30b23f938a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9b83e136-9faf-4f13-9993-36fad125d2bc tempest-ServerRescueNegativeTestJSON-612242326 None] Created volume successfully. Jul 09 15:09:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Acquiring lock "cinder-032da5a6-6e34-41c9-845b-8c1bd2079f82-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Lock "cinder-032da5a6-6e34-41c9-845b-8c1bd2079f82-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Acquiring lock "cinder-quobyte-032da5a6-6e34-41c9-845b-8c1bd2079f82" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:09:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Lock "cinder-quobyte-032da5a6-6e34-41c9-845b-8c1bd2079f82" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:09:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cea606b-dddd-459a-be7a-b8f36af550fe]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:09:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:51 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 Jul 09 15:09:51 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Flow 'volume_create_manager' (ee61b122-605d-432e-bc9a-8ca60ffe0c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d575d530-2598-4eb0-bc77-dd2d237e9263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d575d530-2598-4eb0-bc77-dd2d237e9263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1423327312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af253728-8684-4d8e-b8ba-9759890c5b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fd9a98245944cc9b718b44a8f33f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:52Z,use_quota=True,user_id='89999a31cbb8442a91be89317c24fa3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d459ede-406a-47a3-8bad-b0650b7c2e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d459ede-406a-47a3-8bad-b0650b7c2e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7918217d-39f2-4887-8a52-6368b6a45112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7918217d-39f2-4887-8a52-6368b6a45112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af253728-8684-4d8e-b8ba-9759890c5b2b', 'volume_name': 'volume-af253728-8684-4d8e-b8ba-9759890c5b2b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b5a221-8409-40f6-8ceb-07abd76489a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b5a221-8409-40f6-8ceb-07abd76489a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55371d93-e526-421f-b72a-3cc7781410f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Volume af253728-8684-4d8e-b8ba-9759890c5b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af253728-8684-4d8e-b8ba-9759890c5b2b', 'volume_size': 1} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1423327312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af253728-8684-4d8e-b8ba-9759890c5b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fd9a98245944cc9b718b44a8f33f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:09:52Z,use_quota=True,user_id='89999a31cbb8442a91be89317c24fa3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Creating volume af253728-8684-4d8e-b8ba-9759890c5b2b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:09:52 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:09:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:52 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b 1073741824 Jul 09 15:09:52 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:53 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82" returned: 0 in 1.682s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:53 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82 Jul 09 15:09:53 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:54 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-032da5a6-6e34-41c9-845b-8c1bd2079f82" returned: 0 in 1.645s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Lock "cinder-quobyte-032da5a6-6e34-41c9-845b-8c1bd2079f82" released by "delete_volume" :: held 3.467s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:54 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b 1073741824" returned: 0 in 1.984s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Created reservations ['b542b219-64fc-49fd-a64d-afeb57dd2ba7', '7e3f316c-8e57-4311-aac2-d55f7b92b04b', '2e1db4e5-9b44-4465-a180-90f4b43d922a', '903469e4-cd17-42fa-b94d-add7cc3e7514'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:09:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:55 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b Jul 09 15:09:55 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:09:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:09:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:09:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:09:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:09:55 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:09:55 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:09:56 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.624s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:09:56 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Jul 09 15:09:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Deleted volume successfully. Jul 09 15:09:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b" returned: 0 in 1.791s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:09:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] <== create_volume: return (4128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:09:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.132s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:09:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55371d93-e526-421f-b72a-3cc7781410f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af253728-8684-4d8e-b8ba-9759890c5b2b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bf1e1a-f228-4b49-b4a6-d229b7da99d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:09:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-55510fd6-56d4-4799-980c-241683c1cec9 tempest-TaggedAttachmentsTest-1897912091 None] Lock "cinder-032da5a6-6e34-41c9-845b-8c1bd2079f82-delete_volume" released by "delete_volume" :: held 6.001s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:09:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Volume volume-af253728-8684-4d8e-b8ba-9759890c5b2b (af253728-8684-4d8e-b8ba-9759890c5b2b): created successfully Jul 09 15:09:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bf1e1a-f228-4b49-b4a6-d229b7da99d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:09:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Flow 'volume_create_manager' (ee61b122-605d-432e-bc9a-8ca60ffe0c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:09:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-29ba2803-52b3-4cc5-897e-67881f4c2634 tempest-ServerActionsTestOtherA-1546004042 None] Created volume successfully. Jul 09 15:10:07 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=14,cinder:SELECT=8,cinder:INSERT=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:10:07 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:DELETE=3,cinder:INSERT=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:10:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Acquiring lock "cinder-a367d18b-87cd-4b65-82eb-6fcb272fc4e8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Lock "cinder-a367d18b-87cd-4b65-82eb-6fcb272fc4e8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Acquiring lock "cinder-quobyte-a367d18b-87cd-4b65-82eb-6fcb272fc4e8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Lock "cinder-quobyte-a367d18b-87cd-4b65-82eb-6fcb272fc4e8" acquired by "delete_volume" :: waited 0.060s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb83801-fe0b-4b75-8384-344a002d3a9a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:17 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8 Jul 09 15:10:17 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Flow 'volume_create_manager' (6fdd7b9c-ff28-4312-8e57-623f8efd9bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7f2aec-b56f-409b-b77b-c47eb49a6f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7f2aec-b56f-409b-b77b-c47eb49a6f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-375383753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922cc344-e6a1-43d6-968e-bf20b27db5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92129de51aa347b382f39de7474f2764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:18Z,use_quota=True,user_id='4cd8b415069e405980599298244a82e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e4c852-ffed-4cff-b9a5-7a97bc3be36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e4c852-ffed-4cff-b9a5-7a97bc3be36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf488650-1505-4239-a854-7a12b65d88ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf488650-1505-4239-a854-7a12b65d88ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '922cc344-e6a1-43d6-968e-bf20b27db5c6', 'volume_name': 'volume-922cc344-e6a1-43d6-968e-bf20b27db5c6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6529954-3e69-4d79-be21-6cd628c4ea9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6529954-3e69-4d79-be21-6cd628c4ea9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f68d57e-8358-4b6d-aa12-a4b5f039d1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Volume 922cc344-e6a1-43d6-968e-bf20b27db5c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-922cc344-e6a1-43d6-968e-bf20b27db5c6', 'volume_size': 1} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-375383753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922cc344-e6a1-43d6-968e-bf20b27db5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92129de51aa347b382f39de7474f2764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:18Z,use_quota=True,user_id='4cd8b415069e405980599298244a82e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Creating volume 922cc344-e6a1-43d6-968e-bf20b27db5c6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:10:18 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:18 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6 1073741824 Jul 09 15:10:18 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:18 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8" returned: 0 in 1.590s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:18 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8 Jul 09 15:10:18 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:19 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6 1073741824" returned: 0 in 1.558s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:20 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6 Jul 09 15:10:20 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:20 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a367d18b-87cd-4b65-82eb-6fcb272fc4e8" returned: 0 in 1.427s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Lock "cinder-quobyte-a367d18b-87cd-4b65-82eb-6fcb272fc4e8" released by "delete_volume" :: held 3.130s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Created reservations ['0d9d2f62-3a98-49e7-8497-456f3a2d0ee8', '35bb4d23-e2bd-4d4a-9c75-b17a3325dd4d', 'cffa93bd-e473-4d48-808a-b92cd16c105c', 'af219a09-446a-471f-bf2e-31ec97b99594'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:20 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:10:20 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:21 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6" returned: 0 in 1.506s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] <== create_volume: return (3217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:10:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.220s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f68d57e-8358-4b6d-aa12-a4b5f039d1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-922cc344-e6a1-43d6-968e-bf20b27db5c6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245e46a0-4321-445a-a2c7-b39d50dd6c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Volume volume-922cc344-e6a1-43d6-968e-bf20b27db5c6 (922cc344-e6a1-43d6-968e-bf20b27db5c6): created successfully Jul 09 15:10:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245e46a0-4321-445a-a2c7-b39d50dd6c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Flow 'volume_create_manager' (6fdd7b9c-ff28-4312-8e57-623f8efd9bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-912e1762-4405-47ac-9b28-90afb5961352 tempest-ServersNegativeTestJSON-1313255950 None] Created volume successfully. Jul 09 15:10:22 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.820s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Deleted volume successfully. Jul 09 15:10:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ae0e2a40-0f98-40ff-bba9-3f4137ee25a0 tempest-ServerRescueNegativeTestJSON-612242326 None] Lock "cinder-a367d18b-87cd-4b65-82eb-6fcb272fc4e8-delete_volume" released by "delete_volume" :: held 5.412s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:28 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:10:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Flow 'volume_create_manager' (e93df5e6-ff04-4781-9fbc-b6b4425b5d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf8a6f3-24c3-4b61-bca0-29d8e24708a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf8a6f3-24c3-4b61-bca0-29d8e24708a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-815303698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062958c0-0c7b-4ecc-9ead-9451627e6378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92129de51aa347b382f39de7474f2764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:29Z,use_quota=True,user_id='4cd8b415069e405980599298244a82e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392680c8-1b25-4343-861e-0367a6b474aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392680c8-1b25-4343-861e-0367a6b474aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19dc7d65-3bf0-4d18-b566-131bec800578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19dc7d65-3bf0-4d18-b566-131bec800578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062958c0-0c7b-4ecc-9ead-9451627e6378', 'volume_name': 'volume-062958c0-0c7b-4ecc-9ead-9451627e6378', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869e287d-e830-443b-a6c2-83e44a8dd196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869e287d-e830-443b-a6c2-83e44a8dd196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78eba6fb-d3da-4446-abaf-b68f5caa6b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Volume 062958c0-0c7b-4ecc-9ead-9451627e6378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062958c0-0c7b-4ecc-9ead-9451627e6378', 'volume_size': 1} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-815303698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062958c0-0c7b-4ecc-9ead-9451627e6378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92129de51aa347b382f39de7474f2764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:10:29Z,use_quota=True,user_id='4cd8b415069e405980599298244a82e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Creating volume 062958c0-0c7b-4ecc-9ead-9451627e6378 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:10:29 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:10:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:29 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378 1073741824 Jul 09 15:10:29 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:30 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378 1073741824" returned: 0 in 1.820s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:30 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378 Jul 09 15:10:30 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:31 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378" returned: 0 in 0.952s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] <== create_volume: return (2860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:10:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.864s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78eba6fb-d3da-4446-abaf-b68f5caa6b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062958c0-0c7b-4ecc-9ead-9451627e6378', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61dd040-7c41-44a3-8886-03bc68934da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:10:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Volume volume-062958c0-0c7b-4ecc-9ead-9451627e6378 (062958c0-0c7b-4ecc-9ead-9451627e6378): created successfully Jul 09 15:10:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61dd040-7c41-44a3-8886-03bc68934da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:10:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Flow 'volume_create_manager' (e93df5e6-ff04-4781-9fbc-b6b4425b5d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:10:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a6e10305-702f-495e-a283-8698844ddb2e tempest-ServersNegativeTestJSON-1313255950 None] Created volume successfully. Jul 09 15:10:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Acquiring lock "cinder-062958c0-0c7b-4ecc-9ead-9451627e6378-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Lock "cinder-062958c0-0c7b-4ecc-9ead-9451627e6378-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Acquiring lock "cinder-quobyte-062958c0-0c7b-4ecc-9ead-9451627e6378" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Lock "cinder-quobyte-062958c0-0c7b-4ecc-9ead-9451627e6378" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[038d9f58-880e-479a-80f6-00e019db9e43]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:34 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378 Jul 09 15:10:34 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:35 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378" returned: 0 in 0.920s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:35 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378 Jul 09 15:10:35 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:35 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-062958c0-0c7b-4ecc-9ead-9451627e6378" returned: 0 in 0.670s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Lock "cinder-quobyte-062958c0-0c7b-4ecc-9ead-9451627e6378" released by "delete_volume" :: held 1.650s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Created reservations ['c2c64784-e0ee-4f52-a088-9d975db07360', '2915d23b-ad5c-4705-bcfe-059b1da10c9d', '594d0bda-07e2-4fbb-b29a-bda3684e8f3c', '2fd2bd52-21ff-45d8-9171-c9f445d7f26b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:36 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:10:36 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Acquiring lock "cinder-922cc344-e6a1-43d6-968e-bf20b27db5c6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Lock "cinder-922cc344-e6a1-43d6-968e-bf20b27db5c6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Acquiring lock "cinder-quobyte-922cc344-e6a1-43d6-968e-bf20b27db5c6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Lock "cinder-quobyte-922cc344-e6a1-43d6-968e-bf20b27db5c6" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aff399-45fe-466b-8cbe-82e5ea1e0332]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:36 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6 Jul 09 15:10:36 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:36 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.723s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Deleted volume successfully. Jul 09 15:10:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-324ff0fc-0481-4440-920e-7a18ced6df8e tempest-ServersNegativeTestJSON-1313255950 None] Lock "cinder-062958c0-0c7b-4ecc-9ead-9451627e6378-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:37 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6" returned: 0 in 0.870s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:37 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6 Jul 09 15:10:37 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:38 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-922cc344-e6a1-43d6-968e-bf20b27db5c6" returned: 0 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Lock "cinder-quobyte-922cc344-e6a1-43d6-968e-bf20b27db5c6" released by "delete_volume" :: held 1.568s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Created reservations ['99dd40fc-1f97-4770-a33b-0682a4f048df', 'f125cbf8-9d9e-4bf0-b5f4-f5cba269f1d8', 'c2b55069-6d02-4f1f-b231-5b12724d1707', '058f858c-8a04-437e-889d-aa36ed29a41f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:38 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:10:38 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:38 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.682s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Deleted volume successfully. Jul 09 15:10:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-05b8eba7-0fab-4057-91e3-30f935fa46c1 tempest-ServersNegativeTestJSON-1313255950 None] Lock "cinder-922cc344-e6a1-43d6-968e-bf20b27db5c6-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:10:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:10:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:10:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:10:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:47 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:10:47 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:48 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=20,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:10:48 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.147s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:10:48 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=18,cinder:UPDATE=32,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:10:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-0b08d3ba-02f7-49aa-9b64-b03a58e4d9a6 req-055d463b-9127-469d-906d-c04f01230738 tempest-ServerActionsTestOtherA-1546004042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:10:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-0b08d3ba-02f7-49aa-9b64-b03a58e4d9a6 req-055d463b-9127-469d-906d-c04f01230738 tempest-ServerActionsTestOtherA-1546004042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:10:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[816ac186-c9c1-4c27-9e97-7bdb7e08479b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:10:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0b08d3ba-02f7-49aa-9b64-b03a58e4d9a6 req-055d463b-9127-469d-906d-c04f01230738 tempest-ServerActionsTestOtherA-1546004042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:10:49 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b Jul 09 15:10:49 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:10:50 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Jul 09 15:10:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-0b08d3ba-02f7-49aa-9b64-b03a58e4d9a6 req-055d463b-9127-469d-906d-c04f01230738 tempest-ServerActionsTestOtherA-1546004042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b" returned: 0 in 1.108s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:10:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-0b08d3ba-02f7-49aa-9b64-b03a58e4d9a6 req-055d463b-9127-469d-906d-c04f01230738 tempest-ServerActionsTestOtherA-1546004042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.148s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:10:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-0b08d3ba-02f7-49aa-9b64-b03a58e4d9a6 req-055d463b-9127-469d-906d-c04f01230738 tempest-ServerActionsTestOtherA-1546004042 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-af253728-8684-4d8e-b8ba-9759890c5b2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd8f2e4a-1a48-4e0d-9102-cf679f0f7b8b', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:10:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-0b08d3ba-02f7-49aa-9b64-b03a58e4d9a6 req-055d463b-9127-469d-906d-c04f01230738 tempest-ServerActionsTestOtherA-1546004042 None] attachment_update completed successfully. Jul 09 15:11:00 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:11:03 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:11:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-be8e464d-d78f-41c4-9a11-b8fd383af61c req-23513a6b-08dd-441d-b33b-c986f61f0e97 tempest-ServerActionsTestOtherA-1546004042 None] Terminate volume connection completed successfully. Jul 09 15:11:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-be8e464d-d78f-41c4-9a11-b8fd383af61c req-23513a6b-08dd-441d-b33b-c986f61f0e97 tempest-ServerActionsTestOtherA-1546004042 None] Deleting attachment fd8f2e4a-1a48-4e0d-9102-cf679f0f7b8b. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:11:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-be8e464d-d78f-41c4-9a11-b8fd383af61c req-b0ed9be2-c947-4477-8c92-85b84d5bb1fd tempest-ServerActionsTestOtherA-1546004042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-be8e464d-d78f-41c4-9a11-b8fd383af61c req-b0ed9be2-c947-4477-8c92-85b84d5bb1fd tempest-ServerActionsTestOtherA-1546004042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a58694-719a-4f2e-b12b-295130e8624e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-be8e464d-d78f-41c4-9a11-b8fd383af61c req-b0ed9be2-c947-4477-8c92-85b84d5bb1fd tempest-ServerActionsTestOtherA-1546004042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:07 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b Jul 09 15:11:07 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:07 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-be8e464d-d78f-41c4-9a11-b8fd383af61c req-b0ed9be2-c947-4477-8c92-85b84d5bb1fd tempest-ServerActionsTestOtherA-1546004042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b" returned: 0 in 0.898s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-be8e464d-d78f-41c4-9a11-b8fd383af61c req-b0ed9be2-c947-4477-8c92-85b84d5bb1fd tempest-ServerActionsTestOtherA-1546004042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.927s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-be8e464d-d78f-41c4-9a11-b8fd383af61c req-b0ed9be2-c947-4477-8c92-85b84d5bb1fd tempest-ServerActionsTestOtherA-1546004042 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-af253728-8684-4d8e-b8ba-9759890c5b2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d617a63-63cc-469c-ac7e-1656dfb88c5d', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:11:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-be8e464d-d78f-41c4-9a11-b8fd383af61c req-b0ed9be2-c947-4477-8c92-85b84d5bb1fd tempest-ServerActionsTestOtherA-1546004042 None] attachment_update completed successfully. Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Flow 'volume_create_manager' (79b44a24-1679-4385-8087-f871864206fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3be05d-5b28-4d38-9e5e-7158a0fcbd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3be05d-5b28-4d38-9e5e-7158a0fcbd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-418711056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63b87f3-378c-4185-8573-1686b32430c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6cd75522e5846a8b1164689b812a97d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:13Z,use_quota=True,user_id='c6b1a76170804b9985c81d5819c429cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5ec4b8-74c9-493b-a8d3-b5d675dce54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5ec4b8-74c9-493b-a8d3-b5d675dce54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6a995b-2c22-4f98-8e23-464cf4fccf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6a995b-2c22-4f98-8e23-464cf4fccf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63b87f3-378c-4185-8573-1686b32430c8', 'volume_name': 'volume-b63b87f3-378c-4185-8573-1686b32430c8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eab58b9-de11-49a3-b0f6-36af90812352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eab58b9-de11-49a3-b0f6-36af90812352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398ea541-6ab1-4f24-a2f3-a344a9d2b2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Volume b63b87f3-378c-4185-8573-1686b32430c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63b87f3-378c-4185-8573-1686b32430c8', 'volume_size': 1} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-418711056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63b87f3-378c-4185-8573-1686b32430c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6cd75522e5846a8b1164689b812a97d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:13Z,use_quota=True,user_id='c6b1a76170804b9985c81d5819c429cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Creating volume b63b87f3-378c-4185-8573-1686b32430c8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:12 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:11:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:12 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8 1073741824 Jul 09 15:11:12 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:13 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8 1073741824" returned: 0 in 1.066s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:13 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8 Jul 09 15:11:13 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:14 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8" returned: 0 in 0.796s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:11:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398ea541-6ab1-4f24-a2f3-a344a9d2b2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63b87f3-378c-4185-8573-1686b32430c8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924ca891-cce3-4051-84f0-bafe495194e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Volume volume-b63b87f3-378c-4185-8573-1686b32430c8 (b63b87f3-378c-4185-8573-1686b32430c8): created successfully Jul 09 15:11:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924ca891-cce3-4051-84f0-bafe495194e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Flow 'volume_create_manager' (79b44a24-1679-4385-8087-f871864206fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7b2d2e99-f227-4184-8bd4-2c308d4028f2 tempest-AttachVolumeShelveTestJSON-1799659698 None] Created volume successfully. Jul 09 15:11:24 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:11:24 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:11:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-63fcba12-fad8-4762-b2d8-356486d262c8 req-f58697f8-4195-4bcf-ac13-ef4dedfdea0c tempest-AttachVolumeShelveTestJSON-1799659698 None] No connector for attachment c9ca06ee-3d60-4931-8ad6-4daa4a12bc63; skipping storage backend terminate_connection call. {{(pid=86916) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 15:11:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-63fcba12-fad8-4762-b2d8-356486d262c8 req-f58697f8-4195-4bcf-ac13-ef4dedfdea0c tempest-AttachVolumeShelveTestJSON-1799659698 None] Deleting attachment c9ca06ee-3d60-4931-8ad6-4daa4a12bc63. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:11:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-89d76d7d-47fe-45bc-b892-1de0ef2e4c93 req-ee01d56f-d2c8-420d-8d13-c44e4633986c tempest-ServerActionsTestOtherA-1546004042 None] Terminate volume connection completed successfully. Jul 09 15:11:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-89d76d7d-47fe-45bc-b892-1de0ef2e4c93 req-ee01d56f-d2c8-420d-8d13-c44e4633986c tempest-ServerActionsTestOtherA-1546004042 None] Deleting attachment 9d617a63-63cc-469c-ac7e-1656dfb88c5d. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:11:44 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Flow 'volume_create_manager' (58f6719e-5808-432f-aaec-eae9076e1ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f67a17-f577-4b3b-b05c-4277fdb3a911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f67a17-f577-4b3b-b05c-4277fdb3a911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1663402770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54060709-7371-4ed8-ad5e-21e1a3ee156e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d20383f6a554472a31e133ee8f5fb83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:45Z,use_quota=True,user_id='be4901abf77e454dae25fdbd731cf8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21e756a-b43e-4f08-af60-a5b92d20c318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21e756a-b43e-4f08-af60-a5b92d20c318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33a2e2a-f58f-4f1d-b146-23b4715f63b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33a2e2a-f58f-4f1d-b146-23b4715f63b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54060709-7371-4ed8-ad5e-21e1a3ee156e', 'volume_name': 'volume-54060709-7371-4ed8-ad5e-21e1a3ee156e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275383ab-e0c5-48f7-a046-111b31603404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275383ab-e0c5-48f7-a046-111b31603404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87beebd3-3d13-4cc4-a5c4-8c4507c90738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Volume 54060709-7371-4ed8-ad5e-21e1a3ee156e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54060709-7371-4ed8-ad5e-21e1a3ee156e', 'volume_size': 1} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1663402770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54060709-7371-4ed8-ad5e-21e1a3ee156e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d20383f6a554472a31e133ee8f5fb83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:45Z,use_quota=True,user_id='be4901abf77e454dae25fdbd731cf8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Creating volume 54060709-7371-4ed8-ad5e-21e1a3ee156e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:45 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:11:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:45 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e 1073741824 Jul 09 15:11:45 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:46 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e 1073741824" returned: 0 in 1.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:46 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e Jul 09 15:11:46 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:47 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e" returned: 0 in 0.853s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87beebd3-3d13-4cc4-a5c4-8c4507c90738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54060709-7371-4ed8-ad5e-21e1a3ee156e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968bec53-b89d-4d52-84a7-107fe99726e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Volume volume-54060709-7371-4ed8-ad5e-21e1a3ee156e (54060709-7371-4ed8-ad5e-21e1a3ee156e): created successfully Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968bec53-b89d-4d52-84a7-107fe99726e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Flow 'volume_create_manager' (58f6719e-5808-432f-aaec-eae9076e1ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-07c440e5-f7b5-4f57-90ba-95f83738096b tempest-AttachVolumeNegativeTest-1658335310 None] Created volume successfully. Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:47 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:11:47 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:48 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.743s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:11:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:11:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:11:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:11:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-fec46f52-9789-45c4-9aae-a51078566cba req-44c017da-4ae0-4e07-8ecc-68ca2b8bfc00 tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-fec46f52-9789-45c4-9aae-a51078566cba req-44c017da-4ae0-4e07-8ecc-68ca2b8bfc00 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14298f4-cea8-4890-94f9-2f118fb54822]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-fec46f52-9789-45c4-9aae-a51078566cba req-44c017da-4ae0-4e07-8ecc-68ca2b8bfc00 tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:51 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e Jul 09 15:11:51 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Acquiring lock "cinder-af253728-8684-4d8e-b8ba-9759890c5b2b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Lock "cinder-af253728-8684-4d8e-b8ba-9759890c5b2b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Acquiring lock "cinder-quobyte-af253728-8684-4d8e-b8ba-9759890c5b2b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:11:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Lock "cinder-quobyte-af253728-8684-4d8e-b8ba-9759890c5b2b" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:11:52 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-fec46f52-9789-45c4-9aae-a51078566cba req-44c017da-4ae0-4e07-8ecc-68ca2b8bfc00 tempest-AttachVolumeNegativeTest-1658335310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e" returned: 0 in 1.219s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-fec46f52-9789-45c4-9aae-a51078566cba req-44c017da-4ae0-4e07-8ecc-68ca2b8bfc00 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.236s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf3f74c-727b-432e-9277-8c08b7ddff19]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:11:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-fec46f52-9789-45c4-9aae-a51078566cba req-44c017da-4ae0-4e07-8ecc-68ca2b8bfc00 tempest-AttachVolumeNegativeTest-1658335310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-54060709-7371-4ed8-ad5e-21e1a3ee156e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d5b1f9d-6eaa-4ad5-ab49-4be46df21e08', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:11:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-fec46f52-9789-45c4-9aae-a51078566cba req-44c017da-4ae0-4e07-8ecc-68ca2b8bfc00 tempest-AttachVolumeNegativeTest-1658335310 None] attachment_update completed successfully. Jul 09 15:11:53 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b Jul 09 15:11:53 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:54 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b" returned: 0 in 1.265s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:54 devstack sudo[92185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b Jul 09 15:11:54 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:54 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-af253728-8684-4d8e-b8ba-9759890c5b2b" returned: 0 in 0.828s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Lock "cinder-quobyte-af253728-8684-4d8e-b8ba-9759890c5b2b" released by "delete_volume" :: held 2.169s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Created reservations ['2b0158fb-292d-4c90-aa03-fe8f580295cc', '2d00a5b9-e8a5-4cb6-86cd-1f3f30311a54', 'e8ffe958-bc61-489d-9546-3aa0cf5b10a7', 'baa08a6b-2eb8-48dc-8274-a4762757bea0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:11:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:55 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:11:55 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:55 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.840s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:55 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:11:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Deleted volume successfully. Jul 09 15:11:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27c86984-9ad3-40f7-8161-c96b9d740836 tempest-ServerActionsTestOtherA-1546004042 None] Lock "cinder-af253728-8684-4d8e-b8ba-9759890c5b2b-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Flow 'volume_create_manager' (1989610c-4101-4e2e-8690-46a73c680227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21c8ddd-1ad3-4f54-8345-d0a7c014d101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21c8ddd-1ad3-4f54-8345-d0a7c014d101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2093810148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483e43b6-2026-4061-bb8d-184f9a2da0bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdfde8f99224abbaed18a663ce13242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:57Z,use_quota=True,user_id='ed75c5d20ab24fa2bab6cfa81618ac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942a7e50-36f6-4a11-988b-141ea084b427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942a7e50-36f6-4a11-988b-141ea084b427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f94959-fd9a-47c4-8e9f-b907fe07ffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f94959-fd9a-47c4-8e9f-b907fe07ffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483e43b6-2026-4061-bb8d-184f9a2da0bc', 'volume_name': 'volume-483e43b6-2026-4061-bb8d-184f9a2da0bc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3ba909-9799-4114-a2c7-26f7b2567e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3ba909-9799-4114-a2c7-26f7b2567e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c22998c-ef2c-47c9-a1a6-d1cd3134b462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Volume 483e43b6-2026-4061-bb8d-184f9a2da0bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483e43b6-2026-4061-bb8d-184f9a2da0bc', 'volume_size': 1} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2093810148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483e43b6-2026-4061-bb8d-184f9a2da0bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdfde8f99224abbaed18a663ce13242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:11:57Z,use_quota=True,user_id='ed75c5d20ab24fa2bab6cfa81618ac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Creating volume 483e43b6-2026-4061-bb8d-184f9a2da0bc {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:11:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:11:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:57 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc 1073741824 Jul 09 15:11:57 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:58 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc 1073741824" returned: 0 in 1.179s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:11:58 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc Jul 09 15:11:58 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:11:59 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Jul 09 15:11:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc" returned: 0 in 0.990s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:11:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:11:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:11:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c22998c-ef2c-47c9-a1a6-d1cd3134b462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483e43b6-2026-4061-bb8d-184f9a2da0bc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a126d30d-fcc1-4544-b4a5-867d6ff4b289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:11:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Volume volume-483e43b6-2026-4061-bb8d-184f9a2da0bc (483e43b6-2026-4061-bb8d-184f9a2da0bc): created successfully Jul 09 15:11:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a126d30d-fcc1-4544-b4a5-867d6ff4b289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:11:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Flow 'volume_create_manager' (1989610c-4101-4e2e-8690-46a73c680227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:11:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c84a2bc9-8426-4030-a29f-03fd1c6e746c tempest-AttachVolumeTestJSON-1156489327 None] Created volume successfully. Jul 09 15:12:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-d878f740-01e2-452b-80f9-977001afc36a req-4ff067a6-4143-474e-bc79-33717241a4f3 tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-d878f740-01e2-452b-80f9-977001afc36a req-4ff067a6-4143-474e-bc79-33717241a4f3 tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[693864e3-0d22-471a-8f92-96151e0ed271]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-d878f740-01e2-452b-80f9-977001afc36a req-4ff067a6-4143-474e-bc79-33717241a4f3 tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:03 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc Jul 09 15:12:03 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:04 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-d878f740-01e2-452b-80f9-977001afc36a req-4ff067a6-4143-474e-bc79-33717241a4f3 tempest-AttachVolumeTestJSON-1156489327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc" returned: 0 in 0.871s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-d878f740-01e2-452b-80f9-977001afc36a req-4ff067a6-4143-474e-bc79-33717241a4f3 tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.886s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-d878f740-01e2-452b-80f9-977001afc36a req-4ff067a6-4143-474e-bc79-33717241a4f3 tempest-AttachVolumeTestJSON-1156489327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-483e43b6-2026-4061-bb8d-184f9a2da0bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '871c4d55-8e79-4ab5-a64d-fab750e99d59', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:12:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-d878f740-01e2-452b-80f9-977001afc36a req-4ff067a6-4143-474e-bc79-33717241a4f3 tempest-AttachVolumeTestJSON-1156489327 None] attachment_update completed successfully. Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Flow 'volume_create_manager' (c51309c1-20ab-4326-8e12-a01e680a7a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe1581ad-bdf4-4c2e-a92b-f7bbb8f5632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe1581ad-bdf4-4c2e-a92b-f7bbb8f5632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1671868200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd5dfdb-9972-4630-92fd-4c2b227c9946,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3abc666659a42ebb66aa87a0416ca3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:14Z,use_quota=True,user_id='fa193dd948d1421ea2ea58deecc195f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc74834-c50f-4dd4-8ed0-13358ec54183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc74834-c50f-4dd4-8ed0-13358ec54183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73dcc452-6c9a-435a-8a6b-1f16ceda2ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73dcc452-6c9a-435a-8a6b-1f16ceda2ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd5dfdb-9972-4630-92fd-4c2b227c9946', 'volume_name': 'volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f716842-2848-4473-8d02-c70bb20e544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f716842-2848-4473-8d02-c70bb20e544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63aa083f-6cd4-4a6e-ba8f-96fd956bf9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Volume 6fd5dfdb-9972-4630-92fd-4c2b227c9946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946', 'volume_size': 1} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1671868200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd5dfdb-9972-4630-92fd-4c2b227c9946,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3abc666659a42ebb66aa87a0416ca3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:14Z,use_quota=True,user_id='fa193dd948d1421ea2ea58deecc195f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Creating volume 6fd5dfdb-9972-4630-92fd-4c2b227c9946 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:13 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:12:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:13 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946 1073741824 Jul 09 15:12:13 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:14 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946 1073741824" returned: 0 in 1.009s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:14 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946 Jul 09 15:12:14 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:15 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946" returned: 0 in 0.699s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63aa083f-6cd4-4a6e-ba8f-96fd956bf9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f3099c-9118-4f02-8a22-bcf8a5d269fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Volume volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946 (6fd5dfdb-9972-4630-92fd-4c2b227c9946): created successfully Jul 09 15:12:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f3099c-9118-4f02-8a22-bcf8a5d269fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Flow 'volume_create_manager' (c51309c1-20ab-4326-8e12-a01e680a7a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7f5a2288-5ec5-4be1-b00d-440e4a02dd36 tempest-VolumesTestJSON-897619733 None] Created volume successfully. Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Flow 'volume_create_manager' (558ca91a-43db-49fb-b72c-0e6230a49a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f47c2d-f234-4b60-998d-0bae1b87e1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f47c2d-f234-4b60-998d-0bae1b87e1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-460579013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be1339f-ce1a-4fed-8bf7-c06737581513,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3abc666659a42ebb66aa87a0416ca3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:16Z,use_quota=True,user_id='fa193dd948d1421ea2ea58deecc195f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71ef2c7-d609-486c-9dc3-b596ff7c489d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71ef2c7-d609-486c-9dc3-b596ff7c489d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b26a1a-9d71-4585-b6e9-322783d05605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b26a1a-9d71-4585-b6e9-322783d05605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be1339f-ce1a-4fed-8bf7-c06737581513', 'volume_name': 'volume-3be1339f-ce1a-4fed-8bf7-c06737581513', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a263ef-8d25-4369-b2c2-ba29057c9b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a263ef-8d25-4369-b2c2-ba29057c9b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afdc86e0-7cdb-432f-b112-1d19da4cd458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Volume 3be1339f-ce1a-4fed-8bf7-c06737581513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be1339f-ce1a-4fed-8bf7-c06737581513', 'volume_size': 1} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-460579013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be1339f-ce1a-4fed-8bf7-c06737581513,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3abc666659a42ebb66aa87a0416ca3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:16Z,use_quota=True,user_id='fa193dd948d1421ea2ea58deecc195f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Creating volume 3be1339f-ce1a-4fed-8bf7-c06737581513 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:16 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:12:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:16 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513 1073741824 Jul 09 15:12:16 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:17 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513 1073741824" returned: 0 in 1.240s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:17 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513 Jul 09 15:12:17 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:19 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513" returned: 0 in 1.067s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] <== create_volume: return (2408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.412s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afdc86e0-7cdb-432f-b112-1d19da4cd458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be1339f-ce1a-4fed-8bf7-c06737581513', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460ad5eb-4e75-4589-8f8c-12ffb0186a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Volume volume-3be1339f-ce1a-4fed-8bf7-c06737581513 (3be1339f-ce1a-4fed-8bf7-c06737581513): created successfully Jul 09 15:12:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460ad5eb-4e75-4589-8f8c-12ffb0186a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Flow 'volume_create_manager' (558ca91a-43db-49fb-b72c-0e6230a49a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-da36c38f-568b-4193-9f34-67f589cd5dba tempest-VolumesTestJSON-897619733 None] Created volume successfully. Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Flow 'volume_create_manager' (8c73433a-2135-46be-9511-b70381aec8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90285bf6-b242-402b-86fc-97c08fe870ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90285bf6-b242-402b-86fc-97c08fe870ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-297399515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1a933f-718e-475f-b268-f349a9c90970,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3abc666659a42ebb66aa87a0416ca3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:21Z,use_quota=True,user_id='fa193dd948d1421ea2ea58deecc195f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c3d006-196e-40a4-b1a6-906e505733c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c3d006-196e-40a4-b1a6-906e505733c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3698bce-d01e-4f4c-9464-3202c196ffe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3698bce-d01e-4f4c-9464-3202c196ffe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1a933f-718e-475f-b268-f349a9c90970', 'volume_name': 'volume-5f1a933f-718e-475f-b268-f349a9c90970', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc2f08e-91a4-47e7-8787-32b2f8e7384f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc2f08e-91a4-47e7-8787-32b2f8e7384f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f8280d-92f7-4441-9553-6bc176f28449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Volume 5f1a933f-718e-475f-b268-f349a9c90970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1a933f-718e-475f-b268-f349a9c90970', 'volume_size': 1} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-297399515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1a933f-718e-475f-b268-f349a9c90970,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3abc666659a42ebb66aa87a0416ca3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:21Z,use_quota=True,user_id='fa193dd948d1421ea2ea58deecc195f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Creating volume 5f1a933f-718e-475f-b268-f349a9c90970 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:20 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:12:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:21 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970 1073741824 Jul 09 15:12:21 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:22 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970 1073741824" returned: 0 in 1.530s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:22 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970 Jul 09 15:12:22 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:23 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970" returned: 0 in 1.160s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] <== create_volume: return (2851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.856s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f8280d-92f7-4441-9553-6bc176f28449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1a933f-718e-475f-b268-f349a9c90970', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fd371b-5f57-437d-bc47-6856f7b627fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Volume volume-5f1a933f-718e-475f-b268-f349a9c90970 (5f1a933f-718e-475f-b268-f349a9c90970): created successfully Jul 09 15:12:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fd371b-5f57-437d-bc47-6856f7b627fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Flow 'volume_create_manager' (8c73433a-2135-46be-9511-b70381aec8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-135645df-5a8a-4f83-a7af-eda52465f2ba tempest-VolumesTestJSON-897619733 None] Created volume successfully. Jul 09 15:12:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Acquiring lock "cinder-5f1a933f-718e-475f-b268-f349a9c90970-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Lock "cinder-5f1a933f-718e-475f-b268-f349a9c90970-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Acquiring lock "cinder-quobyte-5f1a933f-718e-475f-b268-f349a9c90970" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Lock "cinder-quobyte-5f1a933f-718e-475f-b268-f349a9c90970" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c12d027-619d-40f8-8dab-2fd30a83ac7c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:25 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970 Jul 09 15:12:25 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Acquiring lock "cinder-b63b87f3-378c-4185-8573-1686b32430c8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Lock "cinder-b63b87f3-378c-4185-8573-1686b32430c8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Acquiring lock "cinder-quobyte-b63b87f3-378c-4185-8573-1686b32430c8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Lock "cinder-quobyte-b63b87f3-378c-4185-8573-1686b32430c8" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f604dc69-21d7-4f83-a85a-b29138ae3c62]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:26 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8 Jul 09 15:12:26 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:26 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970" returned: 0 in 1.303s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:26 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970 Jul 09 15:12:26 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:27 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f1a933f-718e-475f-b268-f349a9c90970" returned: 0 in 0.744s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Lock "cinder-quobyte-5f1a933f-718e-475f-b268-f349a9c90970" released by "delete_volume" :: held 2.138s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:27 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8" returned: 0 in 1.022s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:27 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8 Jul 09 15:12:27 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Created reservations ['2226f97c-43a6-4024-8968-55af4b7e2956', 'ff0aea8e-fcb5-4596-a440-6793ba404a90', 'd884dde8-9bb0-48e6-8e5f-37066e5d0bff', '956890b8-b93f-4dc6-8f23-1f54281f2548'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:27 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:12:27 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:28 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b63b87f3-378c-4185-8573-1686b32430c8" returned: 0 in 0.763s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Lock "cinder-quobyte-b63b87f3-378c-4185-8573-1686b32430c8" released by "delete_volume" :: held 1.830s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Created reservations ['5fa69c13-e132-4ba4-a745-ec1948b7ad34', '7e5f4e81-6a99-47f3-b826-287781960c98', 'e67ae600-55f1-4abf-984d-25c5306c903c', '476c6816-fdcb-427e-a9dc-a616a6bfeb60'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:28 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:12:28 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:28 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.782s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Deleted volume successfully. Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8f6b1e0e-3c58-4416-9f04-15f69add2708 tempest-VolumesTestJSON-897619733 None] Lock "cinder-5f1a933f-718e-475f-b268-f349a9c90970-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Acquiring lock "cinder-3be1339f-ce1a-4fed-8bf7-c06737581513-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Lock "cinder-3be1339f-ce1a-4fed-8bf7-c06737581513-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Acquiring lock "cinder-quobyte-3be1339f-ce1a-4fed-8bf7-c06737581513" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Lock "cinder-quobyte-3be1339f-ce1a-4fed-8bf7-c06737581513" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78ac868-676e-487d-a7b7-7cd5467d9ff0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:29 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513 Jul 09 15:12:29 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:29 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.742s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:29 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Deleted volume successfully. Jul 09 15:12:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59122b1d-4d16-40cb-b591-2b2a5837bd10 tempest-AttachVolumeShelveTestJSON-1799659698 None] Lock "cinder-b63b87f3-378c-4185-8573-1686b32430c8-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:29 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513" returned: 0 in 0.865s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:29 devstack sudo[92606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513 Jul 09 15:12:29 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:30 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be1339f-ce1a-4fed-8bf7-c06737581513" returned: 0 in 0.720s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Lock "cinder-quobyte-3be1339f-ce1a-4fed-8bf7-c06737581513" released by "delete_volume" :: held 1.628s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Created reservations ['81f128c3-ad10-43c2-b738-a7897f667615', '75105d06-c7e3-469d-b269-f97bfe9cd8e1', 'f0b761d4-de19-4ad2-8c46-98af0a0d461e', 'ef12c801-9e39-488e-bd90-16117a8c3205'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:30 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:12:30 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Acquiring lock "cinder-6fd5dfdb-9972-4630-92fd-4c2b227c9946-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Lock "cinder-6fd5dfdb-9972-4630-92fd-4c2b227c9946-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Acquiring lock "cinder-quobyte-6fd5dfdb-9972-4630-92fd-4c2b227c9946" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Lock "cinder-quobyte-6fd5dfdb-9972-4630-92fd-4c2b227c9946" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf1a3aa-4452-48c8-ba46-17012038649c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:31 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946 Jul 09 15:12:31 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:31 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.842s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:31 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Deleted volume successfully. Jul 09 15:12:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9b3bcb6-ab6d-4190-bfd1-70226adea49b tempest-VolumesTestJSON-897619733 None] Lock "cinder-3be1339f-ce1a-4fed-8bf7-c06737581513-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:32 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946" returned: 0 in 0.894s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:32 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946 Jul 09 15:12:32 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:32 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6fd5dfdb-9972-4630-92fd-4c2b227c9946" returned: 0 in 0.681s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Lock "cinder-quobyte-6fd5dfdb-9972-4630-92fd-4c2b227c9946" released by "delete_volume" :: held 1.631s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:33 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Created reservations ['cd80dbaf-11cf-4d93-8458-36cab8945331', '508469e6-5d16-44a6-bba4-df5aa524d84a', 'c43fbc7e-32a7-4841-b60d-6a7edf6dd010', 'eb6f3464-91d4-440e-bc2b-f76e8bb8eee1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:33 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:12:33 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:34 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.919s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:34 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Deleted volume successfully. Jul 09 15:12:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dd4189a6-4a10-4c88-a300-8893d99aaf7e tempest-VolumesTestJSON-897619733 None] Lock "cinder-6fd5dfdb-9972-4630-92fd-4c2b227c9946-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=56,cinder:UPDATE=66,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Flow 'volume_create_manager' (c19a7652-06b5-4d98-ab34-5764bcaac706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5d495d-73a6-436c-899e-ab2c8adfa618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5d495d-73a6-436c-899e-ab2c8adfa618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1978566024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f509c2-1b1d-4f57-bd9d-5bc923709b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7eff7e277e4decaa4c2e5a05d0dcb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:37Z,use_quota=True,user_id='a04d1cac06bb48d5abc9967b2f955682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cd005e-627d-47c0-a7db-479d5ce1c24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cd005e-627d-47c0-a7db-479d5ce1c24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d53145-658e-47ff-9617-bacf4b20f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d53145-658e-47ff-9617-bacf4b20f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f509c2-1b1d-4f57-bd9d-5bc923709b65', 'volume_name': 'volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9d956b-bd7c-4216-ab5e-4b1c9b60d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9d956b-bd7c-4216-ab5e-4b1c9b60d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998f1ed9-da1d-49d4-9287-244ebc358323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Volume b3f509c2-1b1d-4f57-bd9d-5bc923709b65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65', 'volume_size': 1} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1978566024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f509c2-1b1d-4f57-bd9d-5bc923709b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7eff7e277e4decaa4c2e5a05d0dcb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:37Z,use_quota=True,user_id='a04d1cac06bb48d5abc9967b2f955682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Creating volume b3f509c2-1b1d-4f57-bd9d-5bc923709b65 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:37 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:12:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:37 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 1073741824 Jul 09 15:12:37 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:38 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 1073741824" returned: 0 in 0.920s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:38 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 Jul 09 15:12:38 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:39 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" returned: 0 in 0.647s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998f1ed9-da1d-49d4-9287-244ebc358323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb781da6-19ae-41a0-ad6c-70115238dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Volume volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 (b3f509c2-1b1d-4f57-bd9d-5bc923709b65): created successfully Jul 09 15:12:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb781da6-19ae-41a0-ad6c-70115238dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Flow 'volume_create_manager' (c19a7652-06b5-4d98-ab34-5764bcaac706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-31238b68-4b71-4dfc-8b3d-29a99b182583 req-c2c19e8a-b057-410b-aa4b-500a369c82a5 tempest-VolumesSnapshotsTestJSON-1336335292 None] Created volume successfully. Jul 09 15:12:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Creating offline snapshot d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 of volume b3f509c2-1b1d-4f57-bd9d-5bc923709b65 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:12:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed02834-83cd-4f36-9a9c-8914063a35e6]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:40 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 Jul 09 15:12:40 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:41 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" returned: 0 in 0.924s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:41 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 1G Jul 09 15:12:41 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:42 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 1G" returned: 0 in 0.845s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:42 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 Jul 09 15:12:42 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:43 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5" returned: 0 in 0.996s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:43 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 is being set with open permissions: ugo+rw Jul 09 15:12:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:43 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 Jul 09 15:12:43 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:44 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5" returned: 0 in 0.932s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:44 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.info Jul 09 15:12:44 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:45 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.info" returned: 0 in 0.846s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:45 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.info is being set with open permissions: ugo+rw Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:45 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.info Jul 09 15:12:45 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Flow 'volume_create_manager' (651605a8-6dc0-4459-89a1-f7648e3438b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f1a350-fff6-4a64-ac98-9adafbe64be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=47,cinder:UPDATE=53,cinder:INSERT=12,cinder:DELETE=7 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:12:45 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.info" returned: 0 in 0.667s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.333s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f1a350-fff6-4a64-ac98-9adafbe64be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1577684293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fca730-000c-4dc6-a254-35b510187fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378cbd863d6f41fb9fa0689f038616f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:46Z,use_quota=True,user_id='075b35ec53e14a7ca8c89a9b199af0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d268be04-1f68-4f3b-b461-7663414a485c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d268be04-1f68-4f3b-b461-7663414a485c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4162ab9-5d93-4f89-a622-b962da5b6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4162ab9-5d93-4f89-a622-b962da5b6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20fca730-000c-4dc6-a254-35b510187fce', 'volume_name': 'volume-20fca730-000c-4dc6-a254-35b510187fce', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4b8cdd-0ce5-492c-bfbb-cc9ac19555c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4b8cdd-0ce5-492c-bfbb-cc9ac19555c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42e79bd-77e5-4c0f-84f9-d1495af87e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Volume 20fca730-000c-4dc6-a254-35b510187fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20fca730-000c-4dc6-a254-35b510187fce', 'volume_size': 1} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1577684293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fca730-000c-4dc6-a254-35b510187fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378cbd863d6f41fb9fa0689f038616f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:46Z,use_quota=True,user_id='075b35ec53e14a7ca8c89a9b199af0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Creating volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:45 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:12:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:45 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce 1073741824 Jul 09 15:12:45 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-f46b7a8f-3b41-4566-bb0d-6d3d662138a8 req-0277151c-c1be-4787-88c0-f62d64c95a4a tempest-VolumesSnapshotsTestJSON-1336335292 None] Create snapshot completed successfully Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Acquiring lock "cinder-d0a8091e-1bdb-49a6-b7fd-afbd75953bc5-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "cinder-d0a8091e-1bdb-49a6-b7fd-afbd75953bc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Acquiring lock "cinder-quobyte-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "cinder-quobyte-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Acquiring lock "cinder-quobyte-d0a8091e-1bdb-49a6-b7fd-afbd75953bc5" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "cinder-quobyte-d0a8091e-1bdb-49a6-b7fd-afbd75953bc5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Deleting offline snapshot d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 of volume b3f509c2-1b1d-4f57-bd9d-5bc923709b65 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] snapshot_file for this snap is: volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[158f9c14-1851-4357-b891-96b17b72e1ce]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:46 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 Jul 09 15:12:46 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:46 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce 1073741824" returned: 0 in 0.929s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:46 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce Jul 09 15:12:46 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:47 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5" returned: 0 in 0.890s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc9a4b2-46fa-44d4-b71b-60b2d56176e8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:47 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce" returned: 0 in 0.699s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42e79bd-77e5-4c0f-84f9-d1495af87e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20fca730-000c-4dc6-a254-35b510187fce', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1bd9ca-203b-487b-aa7f-ae319a70581c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:47 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 Jul 09 15:12:47 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Volume volume-20fca730-000c-4dc6-a254-35b510187fce (20fca730-000c-4dc6-a254-35b510187fce): created successfully Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1bd9ca-203b-487b-aa7f-ae319a70581c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Flow 'volume_create_manager' (651605a8-6dc0-4459-89a1-f7648e3438b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5b8deda2-68d0-48ce-a5ad-5865aad673e5 tempest-SnapshotsActionsTest-1420040145 None] Created volume successfully. Jul 09 15:12:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-8d4f2c05-7be6-406d-98a3-63e235ec35c9 req-3d358e19-f2d1-4ab8-98a2-c31150081dfb tempest-AttachVolumeTestJSON-1156489327 None] Terminate volume connection completed successfully. Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-8d4f2c05-7be6-406d-98a3-63e235ec35c9 req-3d358e19-f2d1-4ab8-98a2-c31150081dfb tempest-AttachVolumeTestJSON-1156489327 None] Deleting attachment 871c4d55-8e79-4ab5-a64d-fab750e99d59. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:47 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:12:47 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Creating offline snapshot c8b765bf-e49e-40b1-9d90-b9e5c15fca92 of volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[92327d65-2ad1-4eaf-9cf4-1eebb53ca697]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:48 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce Jul 09 15:12:48 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:48 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" returned: 0 in 0.904s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:48 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 Jul 09 15:12:48 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:48 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.762s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:12:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:12:49 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce" returned: 0 in 1.034s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:49 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 1G Jul 09 15:12:49 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:49 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5" returned: 0 in 0.987s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:49 devstack sudo[92788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5 Jul 09 15:12:49 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:50 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65.d0a8091e-1bdb-49a6-b7fd-afbd75953bc5" returned: 0 in 0.752s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:50 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 1G" returned: 0 in 0.935s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:50 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:12:50 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "cinder-quobyte-d0a8091e-1bdb-49a6-b7fd-afbd75953bc5" released by "_delete_snapshot" :: held 3.699s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "cinder-quobyte-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" released by "delete_snapshot" :: held 3.726s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:50 devstack cinder-volume[86916]: WARNING cinder.quota [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG cinder.quota [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Created reservations ['bcc4b84b-939c-4211-81cd-e408f9ccdcf5', '18381b12-0f7e-482d-8938-95ecfd9fe630', '2bb083a3-8f8b-4ad6-b074-a8a6bb75cdb3', '9b68b05f-761e-4e2c-ac39-ac01b5e7ade6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Delete snapshot completed successfully. Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-6601171f-f67c-4a59-87cf-58c47c576799 req-107d68d3-c1df-4b84-9e25-d04cbd8533f3 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "cinder-d0a8091e-1bdb-49a6-b7fd-afbd75953bc5-delete_snapshot" released by "delete_snapshot" :: held 3.879s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:50 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 0.750s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:50 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 is being set with open permissions: ugo+rw Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:50 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:12:50 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Acquiring lock "cinder-b3f509c2-1b1d-4f57-bd9d-5bc923709b65-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "cinder-b3f509c2-1b1d-4f57-bd9d-5bc923709b65-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Acquiring lock "cinder-quobyte-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "cinder-quobyte-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e488ae1-2f01-417b-88ae-1ce9445b5775]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:51 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 Jul 09 15:12:51 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-c1195c79-f348-4d92-b6cf-d23e0b5bdd4a req-e8ea7da8-e2cd-4408-a9f9-351ad832e1ea tempest-AttachVolumeNegativeTest-1658335310 None] Terminate volume connection completed successfully. Jul 09 15:12:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-c1195c79-f348-4d92-b6cf-d23e0b5bdd4a req-e8ea7da8-e2cd-4408-a9f9-351ad832e1ea tempest-AttachVolumeNegativeTest-1658335310 None] Deleting attachment 4d5b1f9d-6eaa-4ad5-ab49-4be46df21e08. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:12:51 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 0.789s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:51 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.info Jul 09 15:12:51 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:51 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" returned: 0 in 0.967s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:51 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65 Jul 09 15:12:51 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:52 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.info" returned: 0 in 0.755s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:52 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.info is being set with open permissions: ugo+rw Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:52 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.info Jul 09 15:12:52 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:52 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" returned: 0 in 0.706s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "cinder-quobyte-b3f509c2-1b1d-4f57-bd9d-5bc923709b65" released by "delete_volume" :: held 1.737s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG cinder.quota [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Created reservations ['3768475a-104d-4d09-a8eb-2b95e7a2067c', 'b3395c2d-bdb9-411d-b180-45a89e6af934', '52ae571c-3f98-4baf-a665-55d3db0f0e31', 'b82914fa-8c6b-4e11-b2f3-7adb9adea33a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:52 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:12:52 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:53 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.info" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.133s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5eb40b8d-9513-493d-ae06-0544debb0c70 tempest-SnapshotsActionsTest-1420040145 None] Create snapshot completed successfully Jul 09 15:12:53 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.919s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:53 devstack cinder-volume[86916]: DEBUG cinder.manager [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:12:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Deleted volume successfully. Jul 09 15:12:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-40e1a95a-3769-4f81-934b-87b431c853e7 req-083f57cb-66af-488b-adeb-f0c40bc39f77 tempest-VolumesSnapshotsTestJSON-1336335292 None] Lock "cinder-b3f509c2-1b1d-4f57-bd9d-5bc923709b65-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:12:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] Creating offline snapshot 07f2f246-b4f4-4325-bec1-7d76984f5c43 of volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:12:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f39a9de-9880-4c1d-a44c-d5030014e3fc]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:54 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:12:54 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:55 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 1.008s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:12:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:55 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 1G Jul 09 15:12:55 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:56 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 1G" returned: 0 in 1.211s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:56 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 Jul 09 15:12:56 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:57 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43" returned: 0 in 0.953s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:57 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 is being set with open permissions: ugo+rw Jul 09 15:12:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:57 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 Jul 09 15:12:57 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:58 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43" returned: 0 in 0.843s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.197s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e13753e6-beea-4ef5-9530-9bc0e7a0d28b tempest-SnapshotsActionsTest-1420040145 None] Create snapshot completed successfully Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Flow 'volume_create_manager' (8f5e36f9-f831-4aa2-90c5-4f1d55ec2747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102dcfad-de2d-4b13-a194-369c9a1301ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102dcfad-de2d-4b13-a194-369c9a1301ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1259835063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fa617c-edfe-4bf5-a4d4-4f01f92b3816,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e0f139e221b4690b748d19ced2a57cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:58Z,use_quota=True,user_id='4655a55fb43c425ca180ec527739df22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cd0acb-03d6-496d-b121-85ffd679bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cd0acb-03d6-496d-b121-85ffd679bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7dc140-ebfc-46ba-988d-714573292787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7dc140-ebfc-46ba-988d-714573292787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fa617c-edfe-4bf5-a4d4-4f01f92b3816', 'volume_name': 'volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5c1954-acfa-4681-b63a-3051ff7a796f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5c1954-acfa-4681-b63a-3051ff7a796f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9b7285-5a47-4c6f-8d67-17d9cfe65ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:12:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Volume f1fa617c-edfe-4bf5-a4d4-4f01f92b3816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816', 'volume_size': 1} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1259835063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fa617c-edfe-4bf5-a4d4-4f01f92b3816,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e0f139e221b4690b748d19ced2a57cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:12:58Z,use_quota=True,user_id='4655a55fb43c425ca180ec527739df22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Creating volume f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:12:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:12:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:58 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 1073741824 Jul 09 15:12:58 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:59 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 1073741824" returned: 0 in 0.891s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:59 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 Jul 09 15:12:59 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-07f2f246-b4f4-4325-bec1-7d76984f5c43-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-07f2f246-b4f4-4325-bec1-7d76984f5c43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-quobyte-07f2f246-b4f4-4325-bec1-7d76984f5c43" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-07f2f246-b4f4-4325-bec1-7d76984f5c43" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Deleting offline snapshot 07f2f246-b4f4-4325-bec1-7d76984f5c43 of volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] snapshot_file for this snap is: volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89857d8-3c79-4237-b5f5-2a102033da7b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:12:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:12:59 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 Jul 09 15:12:59 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:00 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816" returned: 0 in 0.721s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9b7285-5a47-4c6f-8d67-17d9cfe65ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21308754-5621-4a9b-8486-f4e8b18be7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Volume volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 (f1fa617c-edfe-4bf5-a4d4-4f01f92b3816): created successfully Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21308754-5621-4a9b-8486-f4e8b18be7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Flow 'volume_create_manager' (8f5e36f9-f831-4aa2-90c5-4f1d55ec2747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-ca57a557-04ae-4ced-85ba-2e603edbd3af req-76dc1788-3a1d-461e-afa2-6f7277b17bef tempest-VolumesGetTestJSON-2123826046 None] Created volume successfully. Jul 09 15:13:00 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43" returned: 0 in 0.789s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a1c620-90cc-4a0f-8d30-0049234755d1]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:00 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:13:00 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Acquiring lock "cinder-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Lock "cinder-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Acquiring lock "cinder-quobyte-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Lock "cinder-quobyte-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2022d8-cff2-4fa3-8ca0-527bd93c3050]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:01 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 Jul 09 15:13:01 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:01 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 1.428s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:01 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 Jul 09 15:13:01 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:02 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816" returned: 0 in 1.151s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:02 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816 Jul 09 15:13:02 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:02 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43" returned: 0 in 1.203s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:02 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43 Jul 09 15:13:02 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:03 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816" returned: 0 in 0.854s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Lock "cinder-quobyte-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816" released by "delete_volume" :: held 2.099s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:03 devstack cinder-volume[86916]: DEBUG cinder.quota [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Created reservations ['9347315d-ffc1-4ac6-9282-954aa23bec3c', '25159ea9-8ffe-4bd3-81b6-16ebbd187474', '1a052f84-cd32-424c-8cd5-e18460ac96c1', 'e567d6c2-61e9-4520-863c-8c3ce0d8d7d7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:03 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:13:03 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:04 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.07f2f246-b4f4-4325-bec1-7d76984f5c43" returned: 0 in 1.465s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-07f2f246-b4f4-4325-bec1-7d76984f5c43" released by "_delete_snapshot" :: held 5.043s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" released by "delete_snapshot" :: held 5.081s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:04 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.274s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:04 devstack cinder-volume[86916]: DEBUG cinder.manager [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Deleted volume successfully. Jul 09 15:13:04 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Created reservations ['7bdb4404-d286-4d92-91b5-3014b2067598', '9d271a34-8557-4603-92a6-5c6c67791ba4', '84af075b-c6bb-4a06-a330-7bb93c14dcc1', 'ae53f07d-b00c-4721-8374-a9bbf38d67e9'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-febfe63d-4a66-46d6-818b-73228daaed4b req-864c0762-de0b-469b-84b9-0095edae0f03 tempest-VolumesGetTestJSON-2123826046 None] Lock "cinder-f1fa617c-edfe-4bf5-a4d4-4f01f92b3816-delete_volume" released by "delete_volume" :: held 3.738s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Delete snapshot completed successfully. Jul 09 15:13:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-896edaf1-6e4a-49b1-9604-f9d27210b307 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-07f2f246-b4f4-4325-bec1-7d76984f5c43-delete_snapshot" released by "delete_snapshot" :: held 5.295s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] Creating offline snapshot ba124cd9-1add-4135-b1e4-8afe88dae1ee of volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:13:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c019973c-9a9d-4d54-b074-963df944abca]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:05 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:13:05 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:06 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 0.972s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:06 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee 1G Jul 09 15:13:06 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:07 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee 1G" returned: 0 in 0.989s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:07 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee Jul 09 15:13:07 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:08 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee" returned: 0 in 0.952s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:08 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee is being set with open permissions: ugo+rw Jul 09 15:13:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:08 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee Jul 09 15:13:08 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:09 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee" returned: 0 in 0.738s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.792s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-75c7a1bb-85f2-4e2e-91ed-b26d12d2b14f tempest-SnapshotsActionsTest-1420040145 None] Create snapshot completed successfully Jul 09 15:13:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-ba124cd9-1add-4135-b1e4-8afe88dae1ee-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-ba124cd9-1add-4135-b1e4-8afe88dae1ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-quobyte-ba124cd9-1add-4135-b1e4-8afe88dae1ee" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-ba124cd9-1add-4135-b1e4-8afe88dae1ee" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Deleting offline snapshot ba124cd9-1add-4135-b1e4-8afe88dae1ee of volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:13:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] snapshot_file for this snap is: volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:13:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4219190b-8574-4e6d-82e2-da4ab70318d5]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:10 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee Jul 09 15:13:10 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:10 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee" returned: 0 in 0.901s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e1c181-fd7e-4021-8ae1-60b9e39a282b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:11 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:13:11 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:11 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 0.810s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:11 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee Jul 09 15:13:11 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:12 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee" returned: 0 in 0.926s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:12 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee Jul 09 15:13:12 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:13 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.ba124cd9-1add-4135-b1e4-8afe88dae1ee" returned: 0 in 0.800s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-ba124cd9-1add-4135-b1e4-8afe88dae1ee" released by "_delete_snapshot" :: held 3.566s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" released by "delete_snapshot" :: held 3.606s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e5ecff05-ee32-4eeb-a217-1b39d789093d tempest-BackendsCapabilitiesAdminTestsJSON-2091223997 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755428314209, 'free_capacity_gb': 1775.755428314209, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 15:13:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Created reservations ['687534f1-cfd3-4162-897a-79429f778615', '83f30f81-1e51-447a-8e58-eb3126d34739', '787a8c42-509a-4c92-8b83-d5a7eee81c73', '0a566b4b-347d-4eea-96b6-ac9247cd69bd'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Delete snapshot completed successfully. Jul 09 15:13:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6bbcb3df-322b-4ed2-89bc-2d998ac98148 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-ba124cd9-1add-4135-b1e4-8afe88dae1ee-delete_snapshot" released by "delete_snapshot" :: held 3.862s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fd40ae5a-e8c9-4956-a034-572c53550646 tempest-BackendsCapabilitiesAdminTestsJSON-2091223997 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755428314209, 'free_capacity_gb': 1775.755428314209, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 15:13:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] Creating offline snapshot 5b9198da-f550-4e8a-8d2f-128438ac7d23 of volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:13:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62d91fe-917b-4d6a-92f7-3cda80d8861c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:14 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:13:14 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:15 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 0.946s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:15 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 1G Jul 09 15:13:15 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:16 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 1G" returned: 0 in 0.897s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:16 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 Jul 09 15:13:16 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:17 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23" returned: 0 in 0.745s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:17 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 is being set with open permissions: ugo+rw Jul 09 15:13:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:17 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 Jul 09 15:13:17 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:18 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23" returned: 0 in 0.703s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.435s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6dc6c1e0-684e-4ed0-948b-32c69c1ce1cc tempest-SnapshotsActionsTest-1420040145 None] Create snapshot completed successfully Jul 09 15:13:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-5b9198da-f550-4e8a-8d2f-128438ac7d23-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-5b9198da-f550-4e8a-8d2f-128438ac7d23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-quobyte-5b9198da-f550-4e8a-8d2f-128438ac7d23" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-5b9198da-f550-4e8a-8d2f-128438ac7d23" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Deleting offline snapshot 5b9198da-f550-4e8a-8d2f-128438ac7d23 of volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:13:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] snapshot_file for this snap is: volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:13:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a031553-cdef-46ce-a5b2-8613a747f405]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:19 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 Jul 09 15:13:19 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:20 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23" returned: 0 in 0.858s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbeff87-3651-4a1f-a30b-8d74195956c9]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:20 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:13:20 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c94b0198-4741-4dda-8c53-14ac87ff1eeb tempest-GroupsTest-515703589 None] Group tempest-Group1-935196001: creating Jul 09 15:13:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c94b0198-4741-4dda-8c53-14ac87ff1eeb tempest-GroupsTest-515703589 None] Group tempest-Group1-935196001: created successfully Jul 09 15:13:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c94b0198-4741-4dda-8c53-14ac87ff1eeb tempest-GroupsTest-515703589 None] Create group completed successfully. Jul 09 15:13:21 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 1.016s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:21 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 Jul 09 15:13:21 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aae20862-099c-40bf-b8fe-92b56dae4b67 tempest-GroupsTest-515703589 None] Group tempest-Group2-1912032150: creating Jul 09 15:13:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aae20862-099c-40bf-b8fe-92b56dae4b67 tempest-GroupsTest-515703589 None] Group tempest-Group2-1912032150: created successfully Jul 09 15:13:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aae20862-099c-40bf-b8fe-92b56dae4b67 tempest-GroupsTest-515703589 None] Create group completed successfully. Jul 09 15:13:22 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23" returned: 0 in 0.947s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:22 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23 Jul 09 15:13:22 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:22 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.5b9198da-f550-4e8a-8d2f-128438ac7d23" returned: 0 in 0.733s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-5b9198da-f550-4e8a-8d2f-128438ac7d23" released by "_delete_snapshot" :: held 3.686s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" released by "delete_snapshot" :: held 3.717s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Created reservations ['faa28d4b-85aa-471a-b329-3bb142284d9c', '9b1fa670-8ca3-4e4f-94f9-91a308fee387', 'ae2e7099-cfca-4089-8672-e774768c0d6b', '41d721e9-bb0a-4f0f-b648-3aced98fd240'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Delete snapshot completed successfully. Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f0e116d9-3864-4170-b491-80fa5162dd23 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-5b9198da-f550-4e8a-8d2f-128438ac7d23-delete_snapshot" released by "delete_snapshot" :: held 3.894s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Flow 'volume_create_manager' (a296e020-b82c-42ea-825e-5c1efdaae35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9163a8d-7165-40ad-8789-7a3800e0640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9163a8d-7165-40ad-8789-7a3800e0640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-621630905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6615b63-f526-416d-94e7-3fde84802ce4,host='devstack@QuobyteHD#QuobyteHD',id=9759d8e7-0da9-4452-8022-632d39cfd467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80d6daff9dc454cb7aeb5aa461d7808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:24Z,use_quota=True,user_id='42bb6d3c292f495d8c4eb1ccd215b798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c41ecb5-718f-46c4-b09b-e79238a6e291),volume_type_id=5c41ecb5-718f-46c4-b09b-e79238a6e291)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f33cd3d-bb28-4886-9cd3-83415fd111b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f33cd3d-bb28-4886-9cd3-83415fd111b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac824b4-4d7f-44a4-b132-532743bdf848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac824b4-4d7f-44a4-b132-532743bdf848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9759d8e7-0da9-4452-8022-632d39cfd467', 'volume_name': 'volume-9759d8e7-0da9-4452-8022-632d39cfd467', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d94b4a-0e36-481f-87c9-eaefa6c1c936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d94b4a-0e36-481f-87c9-eaefa6c1c936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2add099-e020-4249-936a-0608b4a66f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Volume 9759d8e7-0da9-4452-8022-632d39cfd467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9759d8e7-0da9-4452-8022-632d39cfd467', 'volume_size': 1} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6615b63-f526-416d-94e7-3fde84802ce4,created_at=2026-07-09T13:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-621630905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6615b63-f526-416d-94e7-3fde84802ce4,host='devstack@QuobyteHD#QuobyteHD',id=9759d8e7-0da9-4452-8022-632d39cfd467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80d6daff9dc454cb7aeb5aa461d7808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:24Z,use_quota=True,user_id='42bb6d3c292f495d8c4eb1ccd215b798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c41ecb5-718f-46c4-b09b-e79238a6e291),volume_type_id=5c41ecb5-718f-46c4-b09b-e79238a6e291)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Creating volume 9759d8e7-0da9-4452-8022-632d39cfd467 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:13:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:13:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:24 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467 1073741824 Jul 09 15:13:24 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:25 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467 1073741824" returned: 0 in 1.217s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:25 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467 Jul 09 15:13:25 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:25 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467" returned: 0 in 0.707s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:13:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.912s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] Creating offline snapshot 124a5cc9-42f5-4818-bf85-77e39ee68743 of volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:13:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2add099-e020-4249-936a-0608b4a66f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9759d8e7-0da9-4452-8022-632d39cfd467', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a152f94a-76f7-4751-a8d7-3587d7d3c15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[916e33c1-8c41-4901-b838-3e9e4a179f9e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:26 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Volume volume-9759d8e7-0da9-4452-8022-632d39cfd467 (9759d8e7-0da9-4452-8022-632d39cfd467): created successfully Jul 09 15:13:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a152f94a-76f7-4751-a8d7-3587d7d3c15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Flow 'volume_create_manager' (a296e020-b82c-42ea-825e-5c1efdaae35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6c8ffe78-c728-4c26-8b72-37721c757415 tempest-GroupsTest-515703589 None] Created volume successfully. Jul 09 15:13:26 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:13:26 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Acquiring lock "cinder-quobyte-9759d8e7-0da9-4452-8022-632d39cfd467" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Lock "cinder-quobyte-9759d8e7-0da9-4452-8022-632d39cfd467" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f98bc16-4776-4dc7-9c47-cf302497088e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:27 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 1.535s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:27 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 1G Jul 09 15:13:27 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:27 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467 Jul 09 15:13:27 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:28 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467" returned: 0 in 1.048s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:28 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467 Jul 09 15:13:28 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:28 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 1G" returned: 0 in 1.205s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:28 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 Jul 09 15:13:28 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:29 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9759d8e7-0da9-4452-8022-632d39cfd467" returned: 0 in 0.780s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Lock "cinder-quobyte-9759d8e7-0da9-4452-8022-632d39cfd467" released by "delete_volume" :: held 1.888s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Created reservations ['6b23f45a-03ac-4fbc-9a11-9364d96afe14'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:29 devstack cinder-volume[86916]: WARNING cinder.quota [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2047128270 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2047128270, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:13:29 devstack cinder-volume[86916]: WARNING cinder.quota [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2047128270 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2047128270, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Created reservations ['bfb4dbf3-c946-4fa7-bb95-1eb43974e869', '9a59e94c-a46b-4bf2-810e-05b71b6b5782', '82d4f06d-99b2-49a6-aced-9afb4ad0c808', '52d3f82f-b44d-4d4b-96fd-e98360c6eafc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:29 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743" returned: 0 in 0.847s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:29 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 is being set with open permissions: ugo+rw Jul 09 15:13:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:29 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:13:29 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:29 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 Jul 09 15:13:29 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-01e8ef75-8fda-4ec9-89e0-e546db6faf20 tempest-GroupsTest-515703589 None] Created reservations ['5c53c971-6717-40fe-b6cd-efaa57c47aec'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01e8ef75-8fda-4ec9-89e0-e546db6faf20 tempest-GroupsTest-515703589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01e8ef75-8fda-4ec9-89e0-e546db6faf20 tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-01e8ef75-8fda-4ec9-89e0-e546db6faf20 tempest-GroupsTest-515703589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-01e8ef75-8fda-4ec9-89e0-e546db6faf20 tempest-GroupsTest-515703589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01e8ef75-8fda-4ec9-89e0-e546db6faf20 tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01e8ef75-8fda-4ec9-89e0-e546db6faf20 tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:30 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:30 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:13:30 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743" returned: 0 in 0.871s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.591s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-013a8f05-d48d-4d78-a518-dfe95befc614 tempest-SnapshotsActionsTest-1420040145 None] Create snapshot completed successfully Jul 09 15:13:30 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.967s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:30 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cd75f833-47eb-4a2d-8bb7-c1fc0f1a0d9e tempest-GroupsTest-515703589 None] Delete group completed successfully. Jul 09 15:13:31 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01e8ef75-8fda-4ec9-89e0-e546db6faf20 tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.684s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-01e8ef75-8fda-4ec9-89e0-e546db6faf20 tempest-GroupsTest-515703589 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-01e8ef75-8fda-4ec9-89e0-e546db6faf20 tempest-GroupsTest-515703589 None] Delete group completed successfully. Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-124a5cc9-42f5-4818-bf85-77e39ee68743-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-124a5cc9-42f5-4818-bf85-77e39ee68743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Acquiring lock "cinder-quobyte-124a5cc9-42f5-4818-bf85-77e39ee68743" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-124a5cc9-42f5-4818-bf85-77e39ee68743" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Deleting offline snapshot 124a5cc9-42f5-4818-bf85-77e39ee68743 of volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] snapshot_file for this snap is: volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97698e-beed-4b2c-bca9-6ac2e146deac]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:31 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 Jul 09 15:13:31 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f228e086-0317-4d34-8078-e9e74aa162f8 tempest-GroupsTest-515703589 None] Group tempest-GroupsTest-Group-21786636: creating Jul 09 15:13:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f228e086-0317-4d34-8078-e9e74aa162f8 tempest-GroupsTest-515703589 None] Group tempest-GroupsTest-Group-21786636: created successfully Jul 09 15:13:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f228e086-0317-4d34-8078-e9e74aa162f8 tempest-GroupsTest-515703589 None] Create group completed successfully. Jul 09 15:13:32 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743" returned: 0 in 0.842s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adbc2b5-ef46-46d2-bf5a-55fbf6ad094c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:32 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:13:32 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:33 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 0.848s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:33 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 Jul 09 15:13:33 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Flow 'volume_create_manager' (f3ca11cf-ebf5-4e4a-9149-affea85d7bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b497981-4fc4-4416-a460-e12148a53624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b497981-4fc4-4416-a460-e12148a53624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-45035129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abf31e5e-d8d4-4b31-8137-01b75aa08e82,host='devstack@QuobyteHD#QuobyteHD',id=24fd02a4-36f9-4fa6-b085-c6f2cdc3b514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80d6daff9dc454cb7aeb5aa461d7808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:34Z,use_quota=True,user_id='42bb6d3c292f495d8c4eb1ccd215b798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd47270-9977-4259-b707-6cabd029ed2b),volume_type_id=8fd47270-9977-4259-b707-6cabd029ed2b)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a5271b-fbba-411e-9aaf-4efa3a34ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a5271b-fbba-411e-9aaf-4efa3a34ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1699a986-ecc1-4bdb-9ce6-612d9b1def5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1699a986-ecc1-4bdb-9ce6-612d9b1def5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24fd02a4-36f9-4fa6-b085-c6f2cdc3b514', 'volume_name': 'volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d410769-7402-4cc1-af15-6e2e5bc1a4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d410769-7402-4cc1-af15-6e2e5bc1a4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5267ec3-3d81-47ba-a733-f55443a91eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Volume 24fd02a4-36f9-4fa6-b085-c6f2cdc3b514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514', 'volume_size': 1} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=abf31e5e-d8d4-4b31-8137-01b75aa08e82,created_at=2026-07-09T13:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-45035129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abf31e5e-d8d4-4b31-8137-01b75aa08e82,host='devstack@QuobyteHD#QuobyteHD',id=24fd02a4-36f9-4fa6-b085-c6f2cdc3b514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80d6daff9dc454cb7aeb5aa461d7808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:34Z,use_quota=True,user_id='42bb6d3c292f495d8c4eb1ccd215b798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd47270-9977-4259-b707-6cabd029ed2b),volume_type_id=8fd47270-9977-4259-b707-6cabd029ed2b)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Creating volume 24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:13:34 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:34 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 1073741824 Jul 09 15:13:34 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:34 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743" returned: 0 in 0.974s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:34 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743 Jul 09 15:13:34 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:34 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.124a5cc9-42f5-4818-bf85-77e39ee68743" returned: 0 in 0.725s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-124a5cc9-42f5-4818-bf85-77e39ee68743" released by "_delete_snapshot" :: held 3.487s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" released by "delete_snapshot" :: held 3.515s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Created reservations ['c92e4b07-da1d-42d0-9865-36b5ead17d53', 'e53c7123-6b3a-4050-9b16-7ba6d476e7a6', '6afb9297-f000-42da-a61e-82a9a5def8c1', '13199978-0777-4ba7-afcc-4c50ab023fd3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Delete snapshot completed successfully. Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4b6e254-b233-4fa5-bc4e-40d4ac61ae54 tempest-SnapshotsActionsTest-1912943799 None] Lock "cinder-124a5cc9-42f5-4818-bf85-77e39ee68743-delete_snapshot" released by "delete_snapshot" :: held 3.682s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:35 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 1073741824" returned: 0 in 0.980s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:35 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 Jul 09 15:13:35 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:35 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514" returned: 0 in 0.680s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5267ec3-3d81-47ba-a733-f55443a91eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc949cf-be74-474e-8627-5316ee438da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Volume volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 (24fd02a4-36f9-4fa6-b085-c6f2cdc3b514): created successfully Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc949cf-be74-474e-8627-5316ee438da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Flow 'volume_create_manager' (f3ca11cf-ebf5-4e4a-9149-affea85d7bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3492e86f-ef8e-41b2-9536-bded5aff941e tempest-GroupsTest-515703589 None] Created volume successfully. Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "cinder-c8b765bf-e49e-40b1-9d90-b9e5c15fca92-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Lock "cinder-c8b765bf-e49e-40b1-9d90-b9e5c15fca92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "cinder-quobyte-c8b765bf-e49e-40b1-9d90-b9e5c15fca92" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Lock "cinder-quobyte-c8b765bf-e49e-40b1-9d90-b9e5c15fca92" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Deleting offline snapshot c8b765bf-e49e-40b1-9d90-b9e5c15fca92 of volume 20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] snapshot_file for this snap is: volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63a8928-c19a-45ea-9985-a39612921b22]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:36 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:13:36 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:36 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 0.811s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fca730-000c-4dc6-a254-35b510187fce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6279413f-23f7-4aea-ad82-dfcc6bd90822]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Flow 'volume_create_manager' (f27f339d-f427-43bc-bc12-914216b949fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab481284-0ebc-4d89-88bc-e31fc6dfb2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:37 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce Jul 09 15:13:37 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab481284-0ebc-4d89-88bc-e31fc6dfb2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1396228585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abf31e5e-d8d4-4b31-8137-01b75aa08e82,host='devstack@QuobyteHD#QuobyteHD',id=c0f4afd6-5e15-4082-9938-97582b4a9ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80d6daff9dc454cb7aeb5aa461d7808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:37Z,use_quota=True,user_id='42bb6d3c292f495d8c4eb1ccd215b798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd47270-9977-4259-b707-6cabd029ed2b),volume_type_id=8fd47270-9977-4259-b707-6cabd029ed2b)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e53e33-c96a-4549-b38f-72b6b72d2616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e53e33-c96a-4549-b38f-72b6b72d2616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a466560-9097-4c7d-9663-f50f04f999d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a466560-9097-4c7d-9663-f50f04f999d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f4afd6-5e15-4082-9938-97582b4a9ac9', 'volume_name': 'volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2353a23-fe9a-470c-affe-5cab4f8e9731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2353a23-fe9a-470c-affe-5cab4f8e9731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3db810d-9970-4257-a7be-89600d5e5b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Volume c0f4afd6-5e15-4082-9938-97582b4a9ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9', 'volume_size': 1} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=abf31e5e-d8d4-4b31-8137-01b75aa08e82,created_at=2026-07-09T13:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1396228585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abf31e5e-d8d4-4b31-8137-01b75aa08e82,host='devstack@QuobyteHD#QuobyteHD',id=c0f4afd6-5e15-4082-9938-97582b4a9ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80d6daff9dc454cb7aeb5aa461d7808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:37Z,use_quota=True,user_id='42bb6d3c292f495d8c4eb1ccd215b798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd47270-9977-4259-b707-6cabd029ed2b),volume_type_id=8fd47270-9977-4259-b707-6cabd029ed2b)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Creating volume c0f4afd6-5e15-4082-9938-97582b4a9ac9 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:13:37 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:37 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9 1073741824 Jul 09 15:13:37 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:37 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce" returned: 0 in 0.784s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:37 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:13:37 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:37 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9 1073741824" returned: 0 in 0.877s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:INSERT=23,cinder:UPDATE=83,cinder:SELECT=83,cinder:DELETE=6 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:38 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9 Jul 09 15:13:38 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:38 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 0.786s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:38 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92 Jul 09 15:13:38 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:38 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9" returned: 0 in 0.697s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3db810d-9970-4257-a7be-89600d5e5b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f735a270-8507-4e81-87e0-da5f2cca737f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Volume volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9 (c0f4afd6-5e15-4082-9938-97582b4a9ac9): created successfully Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f735a270-8507-4e81-87e0-da5f2cca737f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Flow 'volume_create_manager' (f27f339d-f427-43bc-bc12-914216b949fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-04651d51-408a-4d50-8d65-de097d57d861 tempest-GroupsTest-515703589 None] Created volume successfully. Jul 09 15:13:39 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce.c8b765bf-e49e-40b1-9d90-b9e5c15fca92" returned: 0 in 0.668s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Lock "cinder-quobyte-c8b765bf-e49e-40b1-9d90-b9e5c15fca92" released by "_delete_snapshot" :: held 3.165s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" released by "delete_snapshot" :: held 3.188s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Created reservations ['d018a787-0a7c-4983-b67e-a2bd4ec5f0ec', '056539ec-7dfc-4bf2-adb0-5a8ce2d28ade', '236e56ff-fd8b-4a3a-a72a-4b49a6c23452', 'f84b797b-74c7-4d43-a5d4-82bda17c70a1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Delete snapshot completed successfully. Jul 09 15:13:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3acf173-4289-45cd-a006-9ef95c01cf55 tempest-SnapshotsActionsTest-1420040145 None] Lock "cinder-c8b765bf-e49e-40b1-9d90-b9e5c15fca92-delete_snapshot" released by "delete_snapshot" :: held 3.344s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ca9ac5dd-679c-486b-af14-288b8be8d9e9 tempest-GroupsTest-515703589 None] Update group completed successfully. Jul 09 15:13:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "cinder-20fca730-000c-4dc6-a254-35b510187fce-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Lock "cinder-20fca730-000c-4dc6-a254-35b510187fce-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e199aa9b-4949-4b31-9515-50b0073446ac]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:40 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce Jul 09 15:13:40 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7536f260-8903-4804-bd29-65321bb907fa tempest-GroupsTest-515703589 None] Update group completed successfully. Jul 09 15:13:41 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce" returned: 0 in 0.900s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:41 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce Jul 09 15:13:41 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:42 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20fca730-000c-4dc6-a254-35b510187fce" returned: 0 in 0.695s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Lock "cinder-quobyte-20fca730-000c-4dc6-a254-35b510187fce" released by "delete_volume" :: held 1.670s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Created reservations ['3037a40c-3293-43ae-afb6-75e8e0f4540e', 'bbe0fff4-f65c-4ad1-b038-6675ca1e05d8', 'd015f490-2f8a-45ce-9a4d-4b59600980f1', '0d18e0d7-0da2-4a08-b1e0-cb18f09bff4c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:42 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:13:42 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Acquiring lock "cinder-quobyte-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Lock "cinder-quobyte-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9362ede0-cc10-484d-a954-fcaebad4e4fc]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:43 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.937s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:43 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Deleted volume successfully. Jul 09 15:13:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90f1c99e-e17c-472a-8ed4-f0387ac8451d tempest-SnapshotsActionsTest-1420040145 None] Lock "cinder-20fca730-000c-4dc6-a254-35b510187fce-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:43 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 Jul 09 15:13:43 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:44 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514" returned: 0 in 1.025s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:44 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514 Jul 09 15:13:44 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:44 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514" returned: 0 in 0.864s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Lock "cinder-quobyte-24fd02a4-36f9-4fa6-b085-c6f2cdc3b514" released by "delete_volume" :: held 1.961s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Acquiring lock "cinder-quobyte-c0f4afd6-5e15-4082-9938-97582b4a9ac9" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:13:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Lock "cinder-quobyte-c0f4afd6-5e15-4082-9938-97582b4a9ac9" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:13:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aed6d78-d1ce-4685-9ba8-f646f5174d6e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:45 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9 Jul 09 15:13:45 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Flow 'volume_create_manager' (6024ad0f-782d-4689-b754-6dc7313424e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac347b4c-2700-4459-8470-e863ae5603b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac347b4c-2700-4459-8470-e863ae5603b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1282302711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6feb97-4a1a-4d12-91df-dafee419ea32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d20383f6a554472a31e133ee8f5fb83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:45Z,use_quota=True,user_id='be4901abf77e454dae25fdbd731cf8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7856d391-2c8d-4192-8bb9-85f194872fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7856d391-2c8d-4192-8bb9-85f194872fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dada1c-f7bf-4f23-b39b-56e89195769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dada1c-f7bf-4f23-b39b-56e89195769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6feb97-4a1a-4d12-91df-dafee419ea32', 'volume_name': 'volume-8e6feb97-4a1a-4d12-91df-dafee419ea32', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db63e85-5cd2-409e-94df-a3bc8027e85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db63e85-5cd2-409e-94df-a3bc8027e85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c10b7d-3d89-41da-88d8-0a44e644fdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Volume 8e6feb97-4a1a-4d12-91df-dafee419ea32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6feb97-4a1a-4d12-91df-dafee419ea32', 'volume_size': 1} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1282302711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6feb97-4a1a-4d12-91df-dafee419ea32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d20383f6a554472a31e133ee8f5fb83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:13:45Z,use_quota=True,user_id='be4901abf77e454dae25fdbd731cf8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Creating volume 8e6feb97-4a1a-4d12-91df-dafee419ea32 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:13:45 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:13:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:45 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 1073741824 Jul 09 15:13:45 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:46 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9" returned: 0 in 1.038s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:46 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9 Jul 09 15:13:46 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:46 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 1073741824" returned: 0 in 0.987s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:46 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=97,cinder:SELECT=92,cinder:INSERT=23,cinder:DELETE=7 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:13:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:46 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 Jul 09 15:13:46 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:46 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c0f4afd6-5e15-4082-9938-97582b4a9ac9" returned: 0 in 0.850s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Lock "cinder-quobyte-c0f4afd6-5e15-4082-9938-97582b4a9ac9" released by "delete_volume" :: held 1.953s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Created reservations ['e9da4a9c-6a26-434d-a150-4c75c81f9921'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:47 devstack cinder-volume[86916]: WARNING cinder.quota [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-136306899 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-136306899, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:13:47 devstack cinder-volume[86916]: WARNING cinder.quota [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-136306899 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-136306899, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Created reservations ['99b51944-8d80-4326-8da9-2a2d95fa62ee', '3038cde0-c874-4ef0-b728-4c981cacd73f', 'aba45b24-7e19-44a5-bfa8-16132c68f180', 'b42e59d6-7c64-4e54-9336-7c7fddda5d6a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Created reservations ['c65051a6-d622-47c3-965e-f136551b2fb7', 'b13c5798-3470-4663-aaed-70fb3a0df0df', '13884be7-fe23-496f-9b2a-623bbaf14bd8', 'cb0387ea-9963-4850-8d84-9af2ef190efa'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:47 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:13:47 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:47 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32" returned: 0 in 0.882s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c10b7d-3d89-41da-88d8-0a44e644fdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6feb97-4a1a-4d12-91df-dafee419ea32', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85561a63-e905-4ef0-a7ba-8ac65dc28afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:13:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Volume volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 (8e6feb97-4a1a-4d12-91df-dafee419ea32): created successfully Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85561a63-e905-4ef0-a7ba-8ac65dc28afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Flow 'volume_create_manager' (6024ad0f-782d-4689-b754-6dc7313424e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-90dab5f7-9b95-4d3a-92b8-41c30097681c tempest-AttachVolumeNegativeTest-1658335310 None] Created volume successfully. Jul 09 15:13:47 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:13:47 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:48 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.882s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3805f526-feca-4d30-bcaa-b17acd1f6729 tempest-GroupsTest-515703589 None] Delete group completed successfully. Jul 09 15:13:48 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.074s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:13:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:13:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:13:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f68cbadf-9c2d-4bba-8c83-b506e4ff9609 req-c238ca5b-fd7e-4167-b474-c14b6c7c822e tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f68cbadf-9c2d-4bba-8c83-b506e4ff9609 req-c238ca5b-fd7e-4167-b474-c14b6c7c822e tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[703d6b58-89c5-45e5-86dc-598b44cdbd59]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:13:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f68cbadf-9c2d-4bba-8c83-b506e4ff9609 req-c238ca5b-fd7e-4167-b474-c14b6c7c822e tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:52 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 Jul 09 15:13:52 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:54 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-f68cbadf-9c2d-4bba-8c83-b506e4ff9609 req-c238ca5b-fd7e-4167-b474-c14b6c7c822e tempest-AttachVolumeNegativeTest-1658335310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32" returned: 0 in 1.802s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-f68cbadf-9c2d-4bba-8c83-b506e4ff9609 req-c238ca5b-fd7e-4167-b474-c14b6c7c822e tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.842s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f68cbadf-9c2d-4bba-8c83-b506e4ff9609 req-c238ca5b-fd7e-4167-b474-c14b6c7c822e tempest-AttachVolumeNegativeTest-1658335310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-8e6feb97-4a1a-4d12-91df-dafee419ea32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9253547b-dc93-46a1-858d-71c84c1eb0f2', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:13:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-f68cbadf-9c2d-4bba-8c83-b506e4ff9609 req-c238ca5b-fd7e-4167-b474-c14b6c7c822e tempest-AttachVolumeNegativeTest-1658335310 None] attachment_update completed successfully. Jul 09 15:13:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c0744d79-b5be-4479-8b54-ebc0713c1887 tempest-GroupsV320Test-515722898 None] Group tempest-GroupsV320Test-Group-370575323: creating Jul 09 15:13:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c0744d79-b5be-4479-8b54-ebc0713c1887 tempest-GroupsV320Test-515722898 None] Group tempest-GroupsV320Test-Group-370575323: created successfully Jul 09 15:13:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c0744d79-b5be-4479-8b54-ebc0713c1887 tempest-GroupsV320Test-515722898 None] Create group completed successfully. Jul 09 15:13:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e9e97da2-15de-402b-ae8e-77cef16600f4 tempest-GroupsV320Test-515722898 None] Created reservations ['b112e441-5536-4b9f-a93d-af64636e610f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:13:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9e97da2-15de-402b-ae8e-77cef16600f4 tempest-GroupsV320Test-515722898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:13:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9e97da2-15de-402b-ae8e-77cef16600f4 tempest-GroupsV320Test-515722898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:13:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9e97da2-15de-402b-ae8e-77cef16600f4 tempest-GroupsV320Test-515722898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:13:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9e97da2-15de-402b-ae8e-77cef16600f4 tempest-GroupsV320Test-515722898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:13:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9e97da2-15de-402b-ae8e-77cef16600f4 tempest-GroupsV320Test-515722898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:13:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9e97da2-15de-402b-ae8e-77cef16600f4 tempest-GroupsV320Test-515722898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:13:58 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:13:58 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:13:59 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 09 15:13:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9e97da2-15de-402b-ae8e-77cef16600f4 tempest-GroupsV320Test-515722898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.755s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:13:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e9e97da2-15de-402b-ae8e-77cef16600f4 tempest-GroupsV320Test-515722898 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:13:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e9e97da2-15de-402b-ae8e-77cef16600f4 tempest-GroupsV320Test-515722898 None] Delete group completed successfully. Jul 09 15:14:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-9db36803-661d-4b34-b78b-0a06c183fb65 req-5f98a1f3-88a1-4f97-bf73-78162be80ac9 tempest-AttachVolumeNegativeTest-1658335310 None] Terminate volume connection completed successfully. Jul 09 15:14:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-9db36803-661d-4b34-b78b-0a06c183fb65 req-5f98a1f3-88a1-4f97-bf73-78162be80ac9 tempest-AttachVolumeNegativeTest-1658335310 None] Deleting attachment 9253547b-dc93-46a1-858d-71c84c1eb0f2. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:14:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Flow 'volume_create_manager' (21258ef4-fcda-4fb5-a51d-f4c98dfe2f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd456f92-2529-4c8c-89a0-053ddaea0026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd456f92-2529-4c8c-89a0-053ddaea0026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-114844928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75c4a20-17ea-46a1-ba7c-2fe771953942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4fd97a2f6f4a3aab1ec467204cef5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:05Z,use_quota=True,user_id='e5e2f2bcdf9141a3b7a33bda83164e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14cf1c32-6219-483b-b631-43a569d51b49),volume_type_id=14cf1c32-6219-483b-b631-43a569d51b49)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560af730-ba70-420e-b469-e854a82d24c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560af730-ba70-420e-b469-e854a82d24c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af266c0e-214e-4944-a77c-756d6bd3b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af266c0e-214e-4944-a77c-756d6bd3b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75c4a20-17ea-46a1-ba7c-2fe771953942', 'volume_name': 'volume-e75c4a20-17ea-46a1-ba7c-2fe771953942', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5bfae2-3750-435c-b825-1b02897f2ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5bfae2-3750-435c-b825-1b02897f2ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cd3752-4e58-4a7b-a6df-6e3dd602322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Volume e75c4a20-17ea-46a1-ba7c-2fe771953942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75c4a20-17ea-46a1-ba7c-2fe771953942', 'volume_size': 1} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-114844928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75c4a20-17ea-46a1-ba7c-2fe771953942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4fd97a2f6f4a3aab1ec467204cef5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:05Z,use_quota=True,user_id='e5e2f2bcdf9141a3b7a33bda83164e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14cf1c32-6219-483b-b631-43a569d51b49),volume_type_id=14cf1c32-6219-483b-b631-43a569d51b49)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Creating volume e75c4a20-17ea-46a1-ba7c-2fe771953942 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:05 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:05 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942 1073741824 Jul 09 15:14:05 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:05 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942 1073741824" returned: 0 in 0.855s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:05 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942 Jul 09 15:14:05 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Flow 'volume_create_manager' (9074429f-f2f9-4795-869f-476f2da83b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bfd5f4-519f-4872-9f87-b696f346b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bfd5f4-519f-4872-9f87-b696f346b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1139143026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542c5fd9-ce36-4287-a370-b9f640d6cceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0b6c782a65425eab68ebcac8e3c5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:06Z,use_quota=True,user_id='815c4a780b2f4358a592f17df8d167d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10efc37f-2ca3-4833-afba-79142dd7ed8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10efc37f-2ca3-4833-afba-79142dd7ed8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d557a68-f3a5-4f03-8a17-7d91b55cc2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d557a68-f3a5-4f03-8a17-7d91b55cc2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542c5fd9-ce36-4287-a370-b9f640d6cceb', 'volume_name': 'volume-542c5fd9-ce36-4287-a370-b9f640d6cceb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6443540a-0b49-47f0-8c5c-8b85a010618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6443540a-0b49-47f0-8c5c-8b85a010618f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88b8b0b-3809-482c-9d9a-4cb086df3a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Volume 542c5fd9-ce36-4287-a370-b9f640d6cceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542c5fd9-ce36-4287-a370-b9f640d6cceb', 'volume_size': 1} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:06 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942" returned: 0 in 0.833s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1139143026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542c5fd9-ce36-4287-a370-b9f640d6cceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0b6c782a65425eab68ebcac8e3c5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:06Z,use_quota=True,user_id='815c4a780b2f4358a592f17df8d167d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Creating volume 542c5fd9-ce36-4287-a370-b9f640d6cceb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:06 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:06 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb 1073741824 Jul 09 15:14:06 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cd3752-4e58-4a7b-a6df-6e3dd602322c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75c4a20-17ea-46a1-ba7c-2fe771953942', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dff2678-0430-4fb8-9176-e0c4a7caeaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Volume volume-e75c4a20-17ea-46a1-ba7c-2fe771953942 (e75c4a20-17ea-46a1-ba7c-2fe771953942): created successfully Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dff2678-0430-4fb8-9176-e0c4a7caeaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Flow 'volume_create_manager' (21258ef4-fcda-4fb5-a51d-f4c98dfe2f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-decb15ce-ea74-4cb3-8b67-31271ee36a6c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Created volume successfully. Jul 09 15:14:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4a3a5649-2c76-445b-8a26-95063e91c45c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4a3a5649-2c76-445b-8a26-95063e91c45c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4a3a5649-2c76-445b-8a26-95063e91c45c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4a3a5649-2c76-445b-8a26-95063e91c45c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4a3a5649-2c76-445b-8a26-95063e91c45c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a3a5649-2c76-445b-8a26-95063e91c45c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:07 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:14:07 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:07 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb 1073741824" returned: 0 in 0.976s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:07 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb Jul 09 15:14:07 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:08 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4a3a5649-2c76-445b-8a26-95063e91c45c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.756s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4a3a5649-2c76-445b-8a26-95063e91c45c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4a3a5649-2c76-445b-8a26-95063e91c45c tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Retype volume completed successfully. Jul 09 15:14:08 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb" returned: 0 in 0.711s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88b8b0b-3809-482c-9d9a-4cb086df3a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542c5fd9-ce36-4287-a370-b9f640d6cceb', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3d41b7-61ac-4de2-81f3-fe6719bf5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Volume volume-542c5fd9-ce36-4287-a370-b9f640d6cceb (542c5fd9-ce36-4287-a370-b9f640d6cceb): created successfully Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3d41b7-61ac-4de2-81f3-fe6719bf5f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Flow 'volume_create_manager' (9074429f-f2f9-4795-869f-476f2da83b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d2aebb9d-d1e2-4fc2-98fa-e610a61b2a59 tempest-VolumeQuotasNegativeTestJSON-632226502 None] Created volume successfully. Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Acquiring lock "cinder-e75c4a20-17ea-46a1-ba7c-2fe771953942-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "cinder-e75c4a20-17ea-46a1-ba7c-2fe771953942-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Acquiring lock "cinder-quobyte-e75c4a20-17ea-46a1-ba7c-2fe771953942" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "cinder-quobyte-e75c4a20-17ea-46a1-ba7c-2fe771953942" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f9d951-9f76-48f5-b3f4-df904f4e9359]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:08 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942 Jul 09 15:14:08 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:09 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942" returned: 0 in 0.750s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:09 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942 Jul 09 15:14:09 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:10 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e75c4a20-17ea-46a1-ba7c-2fe771953942" returned: 0 in 0.660s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "cinder-quobyte-e75c4a20-17ea-46a1-ba7c-2fe771953942" released by "delete_volume" :: held 1.450s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Acquiring lock "cinder-542c5fd9-ce36-4287-a370-b9f640d6cceb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Lock "cinder-542c5fd9-ce36-4287-a370-b9f640d6cceb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:10 devstack cinder-volume[86916]: WARNING cinder.quota [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:14:10 devstack cinder-volume[86916]: WARNING cinder.quota [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Created reservations ['3c06bb53-9776-43b5-9980-d4e78a5e25ea', '0f878e7a-dd30-4af5-a3a6-fc634de96e62', '52678ba8-9f15-41bf-9b09-5584072b106d', 'd66313c9-3831-4b27-aa94-70c0212db294'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Acquiring lock "cinder-quobyte-542c5fd9-ce36-4287-a370-b9f640d6cceb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Lock "cinder-quobyte-542c5fd9-ce36-4287-a370-b9f640d6cceb" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[178d846f-154e-46c4-ba6c-d1863d84f2a7]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:10 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:14:10 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:10 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb Jul 09 15:14:10 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:11 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.655s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:11 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Deleted volume successfully. Jul 09 15:14:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4b26823-144c-47ca-8229-76f2b8b7af34 tempest-VolumeRetypeWithoutMigrationTest-2095331451 None] Lock "cinder-e75c4a20-17ea-46a1-ba7c-2fe771953942-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:11 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb" returned: 0 in 0.858s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:11 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb Jul 09 15:14:11 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:12 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-542c5fd9-ce36-4287-a370-b9f640d6cceb" returned: 0 in 0.903s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Lock "cinder-quobyte-542c5fd9-ce36-4287-a370-b9f640d6cceb" released by "delete_volume" :: held 1.817s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:12 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Created reservations ['a32e9c7c-0248-4ae9-80bf-9204360398ac', '8b263c25-063f-4994-90c9-ded9e26ef77b', '651267e9-755c-444a-ab24-1a9d8dbd6629', '666794c6-1787-44bd-9f2c-dc94a11619da'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:12 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:14:12 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:13 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.080s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Deleted volume successfully. Jul 09 15:14:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-833602f8-6379-4c96-b563-8cb601388c8e tempest-VolumeQuotasNegativeTestJSON-632226502 None] Lock "cinder-542c5fd9-ce36-4287-a370-b9f640d6cceb-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Flow 'volume_create_manager' (d02a3931-f827-4d42-a3b0-736da2ba1209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87475eba-4425-4055-ace2-4337829724d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87475eba-4425-4055-ace2-4337829724d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-449110593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91adffe8-99c0-43eb-babb-a568e385a822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdfde8f99224abbaed18a663ce13242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:16Z,use_quota=True,user_id='ed75c5d20ab24fa2bab6cfa81618ac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f2007b-186f-414c-b45c-31ab6af6f852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f2007b-186f-414c-b45c-31ab6af6f852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f86de5-a7a6-4f60-9f77-2d7d464f2210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f86de5-a7a6-4f60-9f77-2d7d464f2210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91adffe8-99c0-43eb-babb-a568e385a822', 'volume_name': 'volume-91adffe8-99c0-43eb-babb-a568e385a822', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08394956-09a9-467c-9d32-2f8bb2797f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08394956-09a9-467c-9d32-2f8bb2797f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d68794e-db5c-4bf8-8c14-665544b8cf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Volume 91adffe8-99c0-43eb-babb-a568e385a822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91adffe8-99c0-43eb-babb-a568e385a822', 'volume_size': 1} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-449110593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91adffe8-99c0-43eb-babb-a568e385a822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdfde8f99224abbaed18a663ce13242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:16Z,use_quota=True,user_id='ed75c5d20ab24fa2bab6cfa81618ac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Creating volume 91adffe8-99c0-43eb-babb-a568e385a822 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:16 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:14:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:16 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 1073741824 Jul 09 15:14:16 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:17 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 1073741824" returned: 0 in 1.213s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:17 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 Jul 09 15:14:17 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:18 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822" returned: 0 in 0.751s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d68794e-db5c-4bf8-8c14-665544b8cf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91adffe8-99c0-43eb-babb-a568e385a822', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad1fae4-7d5d-4dd6-a75b-878e8e559610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Volume volume-91adffe8-99c0-43eb-babb-a568e385a822 (91adffe8-99c0-43eb-babb-a568e385a822): created successfully Jul 09 15:14:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad1fae4-7d5d-4dd6-a75b-878e8e559610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Flow 'volume_create_manager' (d02a3931-f827-4d42-a3b0-736da2ba1209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4d311029-2e3d-45bc-baef-8d637d15651e tempest-AttachVolumeTestJSON-1156489327 None] Created volume successfully. Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Flow 'volume_create_manager' (20c3cf21-cd00-4128-a5fd-2a3bec20049a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4cc9f2-8579-4fe5-be22-4bb89bd675d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4cc9f2-8579-4fe5-be22-4bb89bd675d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-153524701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3343ac41-ac3a-4b9c-a858-0a4969d47a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f441ffd3c8e409daab35609add2a4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:19Z,use_quota=True,user_id='f9f77dc94af94e699921a5b0b9acadbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e774c7-44c0-426d-b676-8e0189ceb6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e774c7-44c0-426d-b676-8e0189ceb6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8abe946d-66ed-419b-b8c1-322aaca5380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8abe946d-66ed-419b-b8c1-322aaca5380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3343ac41-ac3a-4b9c-a858-0a4969d47a2f', 'volume_name': 'volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797063c3-eb72-4ba9-a830-86fe56127aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797063c3-eb72-4ba9-a830-86fe56127aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084b3c15-7c70-49f0-b4ac-e51f5d205867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Volume 3343ac41-ac3a-4b9c-a858-0a4969d47a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f', 'volume_size': 1} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-153524701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3343ac41-ac3a-4b9c-a858-0a4969d47a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f441ffd3c8e409daab35609add2a4d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:19Z,use_quota=True,user_id='f9f77dc94af94e699921a5b0b9acadbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Creating volume 3343ac41-ac3a-4b9c-a858-0a4969d47a2f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:19 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:19 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f 1073741824 Jul 09 15:14:19 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Flow 'volume_create_manager' (a261ce33-67e4-4aa8-8f34-eb03157c62e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55050534-9e62-4941-930b-b25d717e0654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55050534-9e62-4941-930b-b25d717e0654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1359601161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bd027c-33dc-4702-b8a5-6ae323abc01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5958974e7bf54489a1c31da7be1f79e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:19Z,use_quota=True,user_id='eb90ceefcbd24e2e8edfd6ef652e338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376dfa94-9eef-4638-af00-b843dd6b23ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376dfa94-9eef-4638-af00-b843dd6b23ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1e68d9-beba-4f42-8c33-06027c82894d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1e68d9-beba-4f42-8c33-06027c82894d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15bd027c-33dc-4702-b8a5-6ae323abc01f', 'volume_name': 'volume-15bd027c-33dc-4702-b8a5-6ae323abc01f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01822e2c-6709-44f0-b61e-4e0e4bc355ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01822e2c-6709-44f0-b61e-4e0e4bc355ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deac9f56-9303-4d3e-be6f-621aae05e1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Volume 15bd027c-33dc-4702-b8a5-6ae323abc01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15bd027c-33dc-4702-b8a5-6ae323abc01f', 'volume_size': 1} Jul 09 15:14:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:20 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f 1073741824" returned: 0 in 0.812s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:20 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f Jul 09 15:14:20 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:20 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" returned: 0 in 0.674s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.300s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1359601161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bd027c-33dc-4702-b8a5-6ae323abc01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5958974e7bf54489a1c31da7be1f79e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:19Z,use_quota=True,user_id='eb90ceefcbd24e2e8edfd6ef652e338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Creating volume 15bd027c-33dc-4702-b8a5-6ae323abc01f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:20 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:20 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f 1073741824 Jul 09 15:14:20 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084b3c15-7c70-49f0-b4ac-e51f5d205867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4454b4fa-f6ac-4d2f-b5ac-d7f51177efbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Volume volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f (3343ac41-ac3a-4b9c-a858-0a4969d47a2f): created successfully Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4454b4fa-f6ac-4d2f-b5ac-d7f51177efbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Flow 'volume_create_manager' (20c3cf21-cd00-4128-a5fd-2a3bec20049a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-78fed060-064d-4e5e-8adf-b471ee44931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Created volume successfully. Jul 09 15:14:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:21 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f 1073741824" returned: 0 in 1.061s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:21 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f Jul 09 15:14:21 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-544986ad-fd35-455b-a23e-67b4b42afab9 req-68128234-4249-4306-8d65-537e372e9418 tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:22 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f" returned: 0 in 0.783s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.193s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deac9f56-9303-4d3e-be6f-621aae05e1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15bd027c-33dc-4702-b8a5-6ae323abc01f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c224b6c1-c4d6-454d-8557-3de65a901c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Creating offline snapshot f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 of volume 3343ac41-ac3a-4b9c-a858-0a4969d47a2f {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:14:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Volume volume-15bd027c-33dc-4702-b8a5-6ae323abc01f (15bd027c-33dc-4702-b8a5-6ae323abc01f): created successfully Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c224b6c1-c4d6-454d-8557-3de65a901c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Flow 'volume_create_manager' (a261ce33-67e4-4aa8-8f34-eb03157c62e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81b25bf-e431-435b-8607-dfdce8635e4e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c182ef0b-3e29-4bbb-9cac-9478f5635e7c tempest-VolumesServicesTestJSON-1752954161 None] Created volume successfully. Jul 09 15:14:22 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f Jul 09 15:14:22 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:23 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" returned: 0 in 0.846s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:23 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 1G Jul 09 15:14:23 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Acquiring lock "cinder-15bd027c-33dc-4702-b8a5-6ae323abc01f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Lock "cinder-15bd027c-33dc-4702-b8a5-6ae323abc01f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Acquiring lock "cinder-quobyte-15bd027c-33dc-4702-b8a5-6ae323abc01f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Lock "cinder-quobyte-15bd027c-33dc-4702-b8a5-6ae323abc01f" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec5666a-a53c-4c57-b5ce-5ee2540dc7b0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:24 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f Jul 09 15:14:24 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:24 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 1G" returned: 0 in 0.985s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:24 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 Jul 09 15:14:24 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:24 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f" returned: 0 in 0.853s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:24 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f Jul 09 15:14:24 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:25 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377" returned: 0 in 0.725s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:25 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 is being set with open permissions: ugo+rw Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:25 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 Jul 09 15:14:25 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:25 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-15bd027c-33dc-4702-b8a5-6ae323abc01f" returned: 0 in 0.732s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Lock "cinder-quobyte-15bd027c-33dc-4702-b8a5-6ae323abc01f" released by "delete_volume" :: held 1.647s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Created reservations ['bcda6ac6-4b3c-44b4-9ff1-2a4680aeebaa', '983a7fde-1026-4034-b2d8-fa0c6a2b118d', '7edbc794-349d-4689-84ec-9f754714dcdd', '8cb8b551-96b0-4221-ba03-2c76d5d7531a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:25 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:14:25 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:26 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377" returned: 0 in 0.678s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:26 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.info Jul 09 15:14:26 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:26 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.707s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Deleted volume successfully. Jul 09 15:14:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f2ae1219-d3b7-49f4-a105-c00cfe2c29f1 tempest-VolumesServicesTestJSON-1752954161 None] Lock "cinder-15bd027c-33dc-4702-b8a5-6ae323abc01f-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:26 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.info" returned: 0 in 0.726s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:26 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.info is being set with open permissions: ugo+rw Jul 09 15:14:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:26 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.info Jul 09 15:14:26 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:27 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.info" returned: 0 in 0.696s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.781s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-544986ad-fd35-455b-a23e-67b4b42afab9 req-68128234-4249-4306-8d65-537e372e9418 tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.176s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2786e39-e9bc-4401-b3b6-43087d4932a2]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-544986ad-fd35-455b-a23e-67b4b42afab9 req-68128234-4249-4306-8d65-537e372e9418 tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-90b8602f-d368-441b-95e2-b2ea3c4b8dfd tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Create snapshot completed successfully Jul 09 15:14:27 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 Jul 09 15:14:27 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Acquiring lock "cinder-f70bcf93-cf64-4ef3-8aa1-1c872ab1f377-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "cinder-f70bcf93-cf64-4ef3-8aa1-1c872ab1f377-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Acquiring lock "cinder-quobyte-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "cinder-quobyte-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Acquiring lock "cinder-quobyte-f70bcf93-cf64-4ef3-8aa1-1c872ab1f377" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:28 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-544986ad-fd35-455b-a23e-67b4b42afab9 req-68128234-4249-4306-8d65-537e372e9418 tempest-AttachVolumeTestJSON-1156489327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822" returned: 0 in 1.401s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-544986ad-fd35-455b-a23e-67b4b42afab9 req-68128234-4249-4306-8d65-537e372e9418 tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.425s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "cinder-quobyte-f70bcf93-cf64-4ef3-8aa1-1c872ab1f377" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Deleting offline snapshot f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 of volume 3343ac41-ac3a-4b9c-a858-0a4969d47a2f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:14:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] snapshot_file for this snap is: volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:14:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a5309c-2cb2-4007-81d4-c6382f5d5e3d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-544986ad-fd35-455b-a23e-67b4b42afab9 req-68128234-4249-4306-8d65-537e372e9418 tempest-AttachVolumeTestJSON-1156489327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-91adffe8-99c0-43eb-babb-a568e385a822', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d0f0ab2-f0e1-4f7a-9720-9a507b91739e', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:14:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-544986ad-fd35-455b-a23e-67b4b42afab9 req-68128234-4249-4306-8d65-537e372e9418 tempest-AttachVolumeTestJSON-1156489327 None] attachment_update completed successfully. Jul 09 15:14:29 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 Jul 09 15:14:29 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:29 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377" returned: 0 in 0.905s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:14:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d075cf91-f40b-467c-a4ab-e54a8db47a53]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:30 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f Jul 09 15:14:30 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:30 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" returned: 0 in 0.936s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:30 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 Jul 09 15:14:30 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:31 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377" returned: 0 in 0.974s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:31 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377 Jul 09 15:14:31 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:32 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f.f70bcf93-cf64-4ef3-8aa1-1c872ab1f377" returned: 0 in 0.911s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "cinder-quobyte-f70bcf93-cf64-4ef3-8aa1-1c872ab1f377" released by "_delete_snapshot" :: held 3.910s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "cinder-quobyte-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" released by "delete_snapshot" :: held 3.949s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:32 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Created reservations ['95ab3bed-c974-4903-9c8d-aa8e7b9eed96', '067ae914-016c-4db1-adb9-c15fe6476537', 'b1681751-0d58-4764-8acd-89cda5ba494c', '191ab3ac-3f00-4695-8867-d7afd3721944'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Delete snapshot completed successfully. Jul 09 15:14:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d0320b0c-099d-4ef1-8972-d0908f54c2f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "cinder-f70bcf93-cf64-4ef3-8aa1-1c872ab1f377-delete_snapshot" released by "delete_snapshot" :: held 4.205s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Acquiring lock "cinder-3343ac41-ac3a-4b9c-a858-0a4969d47a2f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "cinder-3343ac41-ac3a-4b9c-a858-0a4969d47a2f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Acquiring lock "cinder-quobyte-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "cinder-quobyte-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de5d572-2554-4161-af7b-f381f096e548]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:33 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f Jul 09 15:14:33 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:34 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" returned: 0 in 1.074s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:34 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f Jul 09 15:14:34 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Flow 'volume_create_manager' (3abc26c3-6a9f-4a7f-86b3-7f718e37ad14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89d7453-1ae9-41a9-9c0e-c76563df2526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89d7453-1ae9-41a9-9c0e-c76563df2526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-151502881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1fae07-f9e3-463a-be8e-b3c47216a357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdfde8f99224abbaed18a663ce13242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:35Z,use_quota=True,user_id='ed75c5d20ab24fa2bab6cfa81618ac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba3b40a-81a0-4b5c-b373-09bc2238542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba3b40a-81a0-4b5c-b373-09bc2238542d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a82b6b-e245-4e37-9023-7d80f8be65bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a82b6b-e245-4e37-9023-7d80f8be65bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce1fae07-f9e3-463a-be8e-b3c47216a357', 'volume_name': 'volume-ce1fae07-f9e3-463a-be8e-b3c47216a357', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0c2cb2-65ba-4101-80bd-42d4082c5306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0c2cb2-65ba-4101-80bd-42d4082c5306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2004957d-be4c-40e7-8304-24d7a8013c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Volume ce1fae07-f9e3-463a-be8e-b3c47216a357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce1fae07-f9e3-463a-be8e-b3c47216a357', 'volume_size': 1} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-151502881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1fae07-f9e3-463a-be8e-b3c47216a357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdfde8f99224abbaed18a663ce13242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:35Z,use_quota=True,user_id='ed75c5d20ab24fa2bab6cfa81618ac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Creating volume ce1fae07-f9e3-463a-be8e-b3c47216a357 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:35 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:35 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 1073741824 Jul 09 15:14:35 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:35 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" returned: 0 in 1.207s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "cinder-quobyte-3343ac41-ac3a-4b9c-a858-0a4969d47a2f" released by "delete_volume" :: held 2.358s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Created reservations ['21b98fdc-ae80-4d42-b18b-8c90f620ce6e', '46074e5f-79cf-4095-b9e8-366525ef938a', '1906283a-63d7-4ff4-8a12-2d402ebcf946', '70967915-04d0-4d1e-ae82-8c0bdcd07865'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:36 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:14:36 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:36 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 1073741824" returned: 0 in 1.487s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:36 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 Jul 09 15:14:36 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:37 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.218s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Deleted volume successfully. Jul 09 15:14:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-02ee629e-12a0-4d82-8c94-111498778ca3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1531533072 None] Lock "cinder-3343ac41-ac3a-4b9c-a858-0a4969d47a2f-delete_volume" released by "delete_volume" :: held 4.051s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:37 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357" returned: 0 in 1.002s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] <== create_volume: return (2567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.570s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2004957d-be4c-40e7-8304-24d7a8013c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1fae07-f9e3-463a-be8e-b3c47216a357', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b75900-4e9b-4bbd-be21-947c45155684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Volume volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 (ce1fae07-f9e3-463a-be8e-b3c47216a357): created successfully Jul 09 15:14:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b75900-4e9b-4bbd-be21-947c45155684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Flow 'volume_create_manager' (3abc26c3-6a9f-4a7f-86b3-7f718e37ad14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8c9ea0ef-fe97-46ef-a508-c2c7571b9c9c tempest-AttachVolumeTestJSON-1156489327 None] Created volume successfully. Jul 09 15:14:42 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=111,cinder:DELETE=7,cinder:SELECT=92,cinder:INSERT=26 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:14:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-91197a9f-37e5-49e5-9337-65693dcdb4e9 req-ae1efa84-dff5-4410-823f-e9ce4a426591 tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-91197a9f-37e5-49e5-9337-65693dcdb4e9 req-ae1efa84-dff5-4410-823f-e9ce4a426591 tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[997c231a-ec70-4181-bf72-636b91aee546]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-91197a9f-37e5-49e5-9337-65693dcdb4e9 req-ae1efa84-dff5-4410-823f-e9ce4a426591 tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:42 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 Jul 09 15:14:42 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:43 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-91197a9f-37e5-49e5-9337-65693dcdb4e9 req-ae1efa84-dff5-4410-823f-e9ce4a426591 tempest-AttachVolumeTestJSON-1156489327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357" returned: 0 in 1.101s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-91197a9f-37e5-49e5-9337-65693dcdb4e9 req-ae1efa84-dff5-4410-823f-e9ce4a426591 tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.146s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-91197a9f-37e5-49e5-9337-65693dcdb4e9 req-ae1efa84-dff5-4410-823f-e9ce4a426591 tempest-AttachVolumeTestJSON-1156489327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-ce1fae07-f9e3-463a-be8e-b3c47216a357', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab2fba91-a6b9-4c78-a1bd-c0bae554ad1f', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:14:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-91197a9f-37e5-49e5-9337-65693dcdb4e9 req-ae1efa84-dff5-4410-823f-e9ce4a426591 tempest-AttachVolumeTestJSON-1156489327 None] attachment_update completed successfully. Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Flow 'volume_create_manager' (7ecb39ca-3ee5-4046-a96a-355e42fb7477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb673229-8b73-4bd2-a8df-095cb3791260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb673229-8b73-4bd2-a8df-095cb3791260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1549067482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdf5a49-d955-4398-9878-7fcb3de4fae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfeb9d1420440e180dd1b3a75780e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:46Z,use_quota=True,user_id='d9692a3ebbf046d2b922b9cf59b75484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1d72d1-9ba9-44bc-a8b2-9edf3413d440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1d72d1-9ba9-44bc-a8b2-9edf3413d440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190a2249-0cb4-4cb0-9d2f-cd72f2a07e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190a2249-0cb4-4cb0-9d2f-cd72f2a07e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fdf5a49-d955-4398-9878-7fcb3de4fae3', 'volume_name': 'volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f397725d-2869-43dc-b7b3-ecab39f04f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f397725d-2869-43dc-b7b3-ecab39f04f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f409dfb-c954-4546-a19c-75ed7acfef2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Volume 1fdf5a49-d955-4398-9878-7fcb3de4fae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3', 'volume_size': 1} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1549067482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdf5a49-d955-4398-9878-7fcb3de4fae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfeb9d1420440e180dd1b3a75780e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:46Z,use_quota=True,user_id='d9692a3ebbf046d2b922b9cf59b75484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Creating volume 1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:46 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:14:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:46 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 1073741824 Jul 09 15:14:46 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:47 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 1073741824" returned: 0 in 0.881s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=90,cinder:SELECT=91,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:47 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 Jul 09 15:14:47 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:47 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:14:47 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:47 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3" returned: 0 in 0.770s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f409dfb-c954-4546-a19c-75ed7acfef2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83f64a7-adeb-40a7-a798-d10f57bc828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Volume volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 (1fdf5a49-d955-4398-9878-7fcb3de4fae3): created successfully Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83f64a7-adeb-40a7-a798-d10f57bc828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Flow 'volume_create_manager' (7ecb39ca-3ee5-4046-a96a-355e42fb7477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-89baf43a-940f-4204-ad42-f0abc67bfd30 tempest-VolumesDeleteCascade-1207909645 None] Created volume successfully. Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Creating offline snapshot a05750f5-0b9d-4c18-bdc1-a20d51cae571 of volume 1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6883b55f-d978-4e32-8e65-3b3cf6540d32]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:48 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 Jul 09 15:14:48 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:48 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.997s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Flow 'volume_create_manager' (45711e99-33c1-498c-a469-ebace566c6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3c57a6-73a6-46cb-83a8-303d32a56aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3c57a6-73a6-46cb-83a8-303d32a56aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-191631275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d99274-f611-4cad-9b89-6ac864cf6f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2c5fe8c89e4060846058a006922bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:49Z,use_quota=True,user_id='3f9abac2e509408697aeb5e54312c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393a077a-ec50-4a62-8b53-8d7d5d253b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393a077a-ec50-4a62-8b53-8d7d5d253b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1adef3-ff3b-418c-96ac-7b1ac6b35e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1adef3-ff3b-418c-96ac-7b1ac6b35e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d99274-f611-4cad-9b89-6ac864cf6f52', 'volume_name': 'volume-42d99274-f611-4cad-9b89-6ac864cf6f52', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe00a81-f5d1-4fa2-adb2-62d2b53c7dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe00a81-f5d1-4fa2-adb2-62d2b53c7dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbd25a5-2e68-46b3-a38c-2edf7a9bfec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Volume 42d99274-f611-4cad-9b89-6ac864cf6f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d99274-f611-4cad-9b89-6ac864cf6f52', 'volume_size': 1} Jul 09 15:14:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-49f22ecb-aba6-4c63-abb7-684f27469f65 req-aec7ae57-756f-406c-a194-c761b34ce0be tempest-AttachVolumeTestJSON-1156489327 None] Terminate volume connection completed successfully. Jul 09 15:14:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-49f22ecb-aba6-4c63-abb7-684f27469f65 req-aec7ae57-756f-406c-a194-c761b34ce0be tempest-AttachVolumeTestJSON-1156489327 None] Deleting attachment 4d0f0ab2-f0e1-4f7a-9720-9a507b91739e. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:14:49 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3" returned: 0 in 0.973s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:49 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 1G Jul 09 15:14:49 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:50 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 1G" returned: 0 in 0.889s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:50 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 Jul 09 15:14:50 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:51 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571" returned: 0 in 0.710s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:51 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 is being set with open permissions: ugo+rw Jul 09 15:14:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:51 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 Jul 09 15:14:51 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:51 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571" returned: 0 in 0.627s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:51 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.info Jul 09 15:14:51 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-3b957cef-b1be-4cb2-a3c5-f26a03693f98 req-f4e0fc2b-9cad-43a4-b8f9-fe68e2031483 tempest-AttachVolumeTestJSON-1156489327 None] Terminate volume connection completed successfully. Jul 09 15:14:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-3b957cef-b1be-4cb2-a3c5-f26a03693f98 req-f4e0fc2b-9cad-43a4-b8f9-fe68e2031483 tempest-AttachVolumeTestJSON-1156489327 None] Deleting attachment ab2fba91-a6b9-4c78-a1bd-c0bae554ad1f. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:14:52 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.info" returned: 0 in 0.695s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:52 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.info is being set with open permissions: ugo+rw Jul 09 15:14:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:52 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.info Jul 09 15:14:52 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:53 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.info" returned: 0 in 0.676s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.688s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.100s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-191631275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d99274-f611-4cad-9b89-6ac864cf6f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2c5fe8c89e4060846058a006922bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:49Z,use_quota=True,user_id='3f9abac2e509408697aeb5e54312c937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Creating volume 42d99274-f611-4cad-9b89-6ac864cf6f52 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:53 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52 1073741824 Jul 09 15:14:53 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4036aafa-9077-4044-84b8-bbab8fdbd05a tempest-VolumesDeleteCascade-1207909645 None] Create snapshot completed successfully Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:53 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52 1073741824" returned: 0 in 0.843s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:54 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52 Jul 09 15:14:54 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:54 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52" returned: 0 in 0.655s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.866s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbd25a5-2e68-46b3-a38c-2edf7a9bfec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d99274-f611-4cad-9b89-6ac864cf6f52', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20237da1-867e-48a3-abdd-6c267081cfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] Creating offline snapshot b4748247-612c-4e38-8095-8d6e3217a2cd of volume 1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:14:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Volume volume-42d99274-f611-4cad-9b89-6ac864cf6f52 (42d99274-f611-4cad-9b89-6ac864cf6f52): created successfully Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20237da1-867e-48a3-abdd-6c267081cfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Flow 'volume_create_manager' (45711e99-33c1-498c-a469-ebace566c6c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d00344-4bf7-469f-bdf7-e96a8beb0ca9]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f1950a56-0865-4691-8362-3b631bdf5653 tempest-VolumesMetadataTest-347716302 None] Created volume successfully. Jul 09 15:14:54 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 Jul 09 15:14:54 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Flow 'volume_create_manager' (b099aa20-06f5-4124-9eeb-a5dc15900ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4947aa80-9406-40ae-9e7d-4b91bc90f8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4947aa80-9406-40ae-9e7d-4b91bc90f8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1269942191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4f778a-e417-4fbd-80df-9e0fb58725ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d20383f6a554472a31e133ee8f5fb83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:55Z,use_quota=True,user_id='be4901abf77e454dae25fdbd731cf8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35442075-461c-4a10-9257-010349386cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35442075-461c-4a10-9257-010349386cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2911c3-520b-46e7-837a-9e8e01c515e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2911c3-520b-46e7-837a-9e8e01c515e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4f778a-e417-4fbd-80df-9e0fb58725ae', 'volume_name': 'volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef830973-46da-41e4-8b33-9a0774999c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef830973-46da-41e4-8b33-9a0774999c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d48f77-ba9e-4a79-b34e-f25f7b4b143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:14:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Volume 0c4f778a-e417-4fbd-80df-9e0fb58725ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae', 'volume_size': 1} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:55 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571" returned: 0 in 0.803s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:55 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd 1G Jul 09 15:14:55 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Acquiring lock "cinder-42d99274-f611-4cad-9b89-6ac864cf6f52-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Lock "cinder-42d99274-f611-4cad-9b89-6ac864cf6f52-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Acquiring lock "cinder-quobyte-42d99274-f611-4cad-9b89-6ac864cf6f52" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Lock "cinder-quobyte-42d99274-f611-4cad-9b89-6ac864cf6f52" acquired by "delete_volume" :: waited 0.049s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fe061b-462c-45e8-a957-43cd29b1eb1b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:56 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52 Jul 09 15:14:56 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:56 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd 1G" returned: 0 in 1.243s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:56 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd Jul 09 15:14:56 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:57 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52" returned: 0 in 0.958s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:57 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52 Jul 09 15:14:57 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:57 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd" returned: 0 in 0.841s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:57 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd is being set with open permissions: ugo+rw Jul 09 15:14:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:57 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd Jul 09 15:14:57 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:58 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-42d99274-f611-4cad-9b89-6ac864cf6f52" returned: 0 in 0.880s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Lock "cinder-quobyte-42d99274-f611-4cad-9b89-6ac864cf6f52" released by "delete_volume" :: held 1.912s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Created reservations ['e15702cf-015b-463b-b52f-7713006936db', 'e0f1cd80-0498-484e-85a1-90b2fc496dd7', '60b582ae-9534-4f5f-be51-e4e2febb3383', 'b267a8c0-0d02-4db3-989f-06c69115e0f9'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:58 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:14:58 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:58 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd" returned: 0 in 0.794s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.814s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.307s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1269942191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4f778a-e417-4fbd-80df-9e0fb58725ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d20383f6a554472a31e133ee8f5fb83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:14:55Z,use_quota=True,user_id='be4901abf77e454dae25fdbd731cf8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Creating volume 0c4f778a-e417-4fbd-80df-9e0fb58725ae {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:14:58 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:14:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:58 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae 1073741824 Jul 09 15:14:58 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-44f0f547-678d-4597-b48a-0c60a1575d47 tempest-VolumesDeleteCascade-1207909645 None] Create snapshot completed successfully Jul 09 15:14:59 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.841s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:14:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Deleted volume successfully. Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e619a10a-f447-49a7-873a-258a6da954a7 tempest-VolumesMetadataTest-347716302 None] Lock "cinder-42d99274-f611-4cad-9b89-6ac864cf6f52-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-1fdf5a49-d955-4398-9878-7fcb3de4fae3-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-1fdf5a49-d955-4398-9878-7fcb3de4fae3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Performing cascade delete. {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-a05750f5-0b9d-4c18-bdc1-a20d51cae571-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-a05750f5-0b9d-4c18-bdc1-a20d51cae571-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-1fdf5a49-d955-4398-9878-7fcb3de4fae3" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-1fdf5a49-d955-4398-9878-7fcb3de4fae3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-a05750f5-0b9d-4c18-bdc1-a20d51cae571" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-a05750f5-0b9d-4c18-bdc1-a20d51cae571" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Deleting offline snapshot a05750f5-0b9d-4c18-bdc1-a20d51cae571 of volume 1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] snapshot_file for this snap is: volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea8d5a5-0c65-42d0-8033-429f618eb6ed]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:59 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 Jul 09 15:14:59 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:14:59 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae 1073741824" returned: 0 in 1.080s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:14:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:14:59 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae Jul 09 15:14:59 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:00 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571" returned: 0 in 0.933s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684fd32-a0b1-442e-8b95-0f0017a2423e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:00 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae" returned: 0 in 0.756s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d48f77-ba9e-4a79-b34e-f25f7b4b143a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b796d01-929c-4165-acb2-8d2ab478158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Volume volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae (0c4f778a-e417-4fbd-80df-9e0fb58725ae): created successfully Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b796d01-929c-4165-acb2-8d2ab478158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Flow 'volume_create_manager' (b099aa20-06f5-4124-9eeb-a5dc15900ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-00e46cd3-5a5a-4a66-a1ce-5f118b6fcdee tempest-AttachVolumeNegativeTest-1658335310 None] Created volume successfully. Jul 09 15:15:00 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 Jul 09 15:15:00 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:01 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3" returned: 0 in 0.863s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[864fcb32-a63b-47db-b774-186a16a04679]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:01 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd Jul 09 15:15:01 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:02 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd" returned: 0 in 0.831s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:15:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1f570b-4a0b-44ff-a544-a8461033566c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:02 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 Jul 09 15:15:02 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "cinder-ce1fae07-f9e3-463a-be8e-b3c47216a357-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-ce1fae07-f9e3-463a-be8e-b3c47216a357-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:03 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571" returned: 0 in 0.934s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "cinder-quobyte-ce1fae07-f9e3-463a-be8e-b3c47216a357" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6867f8-d846-4cf0-be6a-c3cee229f225]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-quobyte-ce1fae07-f9e3-463a-be8e-b3c47216a357" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[478c3962-55b1-48a8-b887-3181403cb8ae]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:03 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 Jul 09 15:15:03 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:03 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 Jul 09 15:15:03 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Flow 'volume_create_manager' (ace91390-ef01-45d4-bfe4-10724bf3dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71dd54c-f7b8-412a-8cbd-9c0f6356f3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71dd54c-f7b8-412a-8cbd-9c0f6356f3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-879010910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c1863f-20e5-4653-ba7d-8e47337139b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d05ec04511468ba75cff7af56319aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:04Z,use_quota=True,user_id='d5d769361eeb430fba25e077bbdc93f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a8db4b-1321-4e3e-80ba-61d3067617ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a8db4b-1321-4e3e-80ba-61d3067617ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d969fc1-7fe2-4e3d-8264-5a226832edc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d969fc1-7fe2-4e3d-8264-5a226832edc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c1863f-20e5-4653-ba7d-8e47337139b6', 'volume_name': 'volume-a3c1863f-20e5-4653-ba7d-8e47337139b6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604882fd-db7e-4d14-9ed4-3db3f8f2eeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604882fd-db7e-4d14-9ed4-3db3f8f2eeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9ff72b-e508-4848-a3cb-ca6e885f0390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Volume a3c1863f-20e5-4653-ba7d-8e47337139b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c1863f-20e5-4653-ba7d-8e47337139b6', 'volume_size': 1} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-879010910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c1863f-20e5-4653-ba7d-8e47337139b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d05ec04511468ba75cff7af56319aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:04Z,use_quota=True,user_id='d5d769361eeb430fba25e077bbdc93f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Creating volume a3c1863f-20e5-4653-ba7d-8e47337139b6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:03 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:03 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6 1073741824 Jul 09 15:15:03 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-08b27429-1529-4a4f-b6f2-de64aa8133ed req-6c02f829-7ffe-4047-a9f9-0750014492fd tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:04 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357" returned: 0 in 0.899s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:04 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357 Jul 09 15:15:04 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:04 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3" returned: 0 in 0.986s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:04 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 Jul 09 15:15:04 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:04 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6 1073741824" returned: 0 in 0.938s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:04 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6 Jul 09 15:15:04 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:04 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ce1fae07-f9e3-463a-be8e-b3c47216a357" returned: 0 in 0.722s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-quobyte-ce1fae07-f9e3-463a-be8e-b3c47216a357" released by "delete_volume" :: held 1.665s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Created reservations ['dd0e9636-6906-4747-97e1-4d7012eec1da', '1c8b5ebf-eb79-4372-af1e-efeb39a45be8', 'c99a4680-9822-40d3-b885-e7081ffc177d', 'd1fd065c-11da-4048-b105-3c4ad06d9882'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:04 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:04 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571" returned: 0 in 0.829s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:04 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:04 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571 Jul 09 15:15:04 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "cinder-91adffe8-99c0-43eb-babb-a568e385a822-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-91adffe8-99c0-43eb-babb-a568e385a822-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "cinder-quobyte-91adffe8-99c0-43eb-babb-a568e385a822" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-quobyte-91adffe8-99c0-43eb-babb-a568e385a822" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:05 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6" returned: 0 in 0.836s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-08b27429-1529-4a4f-b6f2-de64aa8133ed req-6c02f829-7ffe-4047-a9f9-0750014492fd tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.710s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[43009448-7469-453d-a8cc-b197546fd537]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a006b3f7-2ee0-404d-bb20-aedc6757620a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-08b27429-1529-4a4f-b6f2-de64aa8133ed req-6c02f829-7ffe-4047-a9f9-0750014492fd tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9ff72b-e508-4848-a3cb-ca6e885f0390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c1863f-20e5-4653-ba7d-8e47337139b6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81810972-62a0-496c-b256-8e55ebb27404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:05 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.756s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Deleted volume successfully. Jul 09 15:15:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Volume volume-a3c1863f-20e5-4653-ba7d-8e47337139b6 (a3c1863f-20e5-4653-ba7d-8e47337139b6): created successfully Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81810972-62a0-496c-b256-8e55ebb27404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Flow 'volume_create_manager' (ace91390-ef01-45d4-bfe4-10724bf3dda5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:05 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 Jul 09 15:15:05 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c1da461-da3e-40e3-8cac-a70711d677f8 tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-ce1fae07-f9e3-463a-be8e-b3c47216a357-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-500e35d9-81ee-430a-8ed2-abfa7ffbebfc tempest-VolumesTransfersTest-1155302584 None] Created volume successfully. Jul 09 15:15:05 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae Jul 09 15:15:05 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:05 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.a05750f5-0b9d-4c18-bdc1-a20d51cae571" returned: 0 in 0.944s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd -F qcow2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:05 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd -F qcow2 Jul 09 15:15:05 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:06 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-08b27429-1529-4a4f-b6f2-de64aa8133ed req-6c02f829-7ffe-4047-a9f9-0750014492fd tempest-AttachVolumeNegativeTest-1658335310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae" returned: 0 in 0.879s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-08b27429-1529-4a4f-b6f2-de64aa8133ed req-6c02f829-7ffe-4047-a9f9-0750014492fd tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-08b27429-1529-4a4f-b6f2-de64aa8133ed req-6c02f829-7ffe-4047-a9f9-0750014492fd tempest-AttachVolumeNegativeTest-1658335310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79105f6c-5f0c-4dda-ad2f-76c8ba50bbd7', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:15:06 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822" returned: 0 in 1.002s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:06 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822 Jul 09 15:15:06 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-08b27429-1529-4a4f-b6f2-de64aa8133ed req-6c02f829-7ffe-4047-a9f9-0750014492fd tempest-AttachVolumeNegativeTest-1658335310 None] attachment_update completed successfully. Jul 09 15:15:06 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd -F qcow2" returned: 0 in 0.931s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-a05750f5-0b9d-4c18-bdc1-a20d51cae571" released by "_delete_snapshot" :: held 7.483s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-1fdf5a49-d955-4398-9878-7fcb3de4fae3" released by "delete_snapshot" :: held 7.529s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Created reservations ['0a0524e8-5c90-4f49-971a-bf9be0809717', '5a571422-6ce2-4972-877b-fc7e63d1dc93', '6beca0a0-66a5-483a-8285-cf89bd0d5ae2', '154c3d9b-a0b7-4d6c-a0d8-c6683edf3f76'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Delete snapshot completed successfully. Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-a05750f5-0b9d-4c18-bdc1-a20d51cae571-delete_snapshot" released by "delete_snapshot" :: held 7.788s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-b4748247-612c-4e38-8095-8d6e3217a2cd-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-b4748247-612c-4e38-8095-8d6e3217a2cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-1fdf5a49-d955-4398-9878-7fcb3de4fae3" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-1fdf5a49-d955-4398-9878-7fcb3de4fae3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-b4748247-612c-4e38-8095-8d6e3217a2cd" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-b4748247-612c-4e38-8095-8d6e3217a2cd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Deleting offline snapshot b4748247-612c-4e38-8095-8d6e3217a2cd of volume 1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] snapshot_file for this snap is: volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[843c8747-45f4-4c70-a4be-f295c918d9dc]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:07 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd Jul 09 15:15:07 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:07 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-91adffe8-99c0-43eb-babb-a568e385a822" returned: 0 in 0.914s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-quobyte-91adffe8-99c0-43eb-babb-a568e385a822" released by "delete_volume" :: held 1.998s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9a48b8a6-5a30-41ef-875a-df068e62eccf tempest-VolumesTransfersTest-448170553 None] Transfer volume completed successfully. Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Created reservations ['aca937c0-af51-44c7-a5e0-d2a8cc07e445', '677a9610-aede-4ce5-9627-1c18cc51be32', '6a17c0f3-d772-4ded-90bb-25ba7aa90d9d', '07ed8a7f-2057-4936-8ca0-abea43fe7431'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:07 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:07 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "cinder-483e43b6-2026-4061-bb8d-184f9a2da0bc-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-483e43b6-2026-4061-bb8d-184f9a2da0bc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "cinder-quobyte-483e43b6-2026-4061-bb8d-184f9a2da0bc" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-quobyte-483e43b6-2026-4061-bb8d-184f9a2da0bc" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c0bcf9-759e-4d16-b725-627c534f9b8d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:08 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc Jul 09 15:15:08 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:08 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd" returned: 0 in 1.054s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9de1370-011f-4e91-97ce-bf4d4236bb3d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:08 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 Jul 09 15:15:08 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:08 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.930s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Deleted volume successfully. Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d049552a-2dad-4b19-a45b-d5f5faba9363 tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-91adffe8-99c0-43eb-babb-a568e385a822-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Acquiring lock "cinder-a3c1863f-20e5-4653-ba7d-8e47337139b6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Lock "cinder-a3c1863f-20e5-4653-ba7d-8e47337139b6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Acquiring lock "cinder-quobyte-a3c1863f-20e5-4653-ba7d-8e47337139b6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Lock "cinder-quobyte-a3c1863f-20e5-4653-ba7d-8e47337139b6" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc73fe60-266f-425d-8f9b-d15f940b5372]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:08 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6 Jul 09 15:15:08 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:08 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc" returned: 0 in 0.896s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:08 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc Jul 09 15:15:08 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:09 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3" returned: 0 in 0.903s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:09 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd Jul 09 15:15:09 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:09 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6" returned: 0 in 0.783s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:09 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6 Jul 09 15:15:09 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:09 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-483e43b6-2026-4061-bb8d-184f9a2da0bc" returned: 0 in 0.697s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-quobyte-483e43b6-2026-4061-bb8d-184f9a2da0bc" released by "delete_volume" :: held 1.673s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Created reservations ['d967afbe-19a0-4712-bd81-5d238e1ee0d8', '9c963383-01b6-4692-a2ca-81659b3268e3', '508bf2f8-9e02-4291-af0d-c1d1006f739a', 'f2b67d30-12d1-4451-b6f4-2889bf6e259c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:09 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:09 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:10 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd" returned: 0 in 0.812s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:10 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd Jul 09 15:15:10 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:10 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c1863f-20e5-4653-ba7d-8e47337139b6" returned: 0 in 0.748s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Lock "cinder-quobyte-a3c1863f-20e5-4653-ba7d-8e47337139b6" released by "delete_volume" :: held 1.591s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Created reservations ['8668da9e-974b-448d-ac81-f31137388da8', 'c19329a4-75e1-4a25-a0a8-fc139bd75d94', '0caa708b-a72e-4907-9a41-366d50b88680', '867fc47d-fdb1-4814-8918-5331fb5f6284'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:10 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:10 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:10 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.746s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Deleted volume successfully. Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fcc27400-781c-4f0c-8abc-f2fe675843af tempest-AttachVolumeTestJSON-1156489327 None] Lock "cinder-483e43b6-2026-4061-bb8d-184f9a2da0bc-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:10 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3.b4748247-612c-4e38-8095-8d6e3217a2cd" returned: 0 in 0.810s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-b4748247-612c-4e38-8095-8d6e3217a2cd" released by "_delete_snapshot" :: held 3.711s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-1fdf5a49-d955-4398-9878-7fcb3de4fae3" released by "delete_snapshot" :: held 3.737s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Created reservations ['bc5069e2-c4e1-459b-be2c-553f14deb655', '9672e39a-bd4c-4fa5-93cf-fb52fc4c539b', '24bff3ed-73d9-44aa-8df7-6c9b0e4822e3', '0a7e892b-c69c-4740-b826-8176c40576fd'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Delete snapshot completed successfully. Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-b4748247-612c-4e38-8095-8d6e3217a2cd-delete_snapshot" released by "delete_snapshot" :: held 3.927s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Snapshots deleted, issuing volume delete {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-1fdf5a49-d955-4398-9878-7fcb3de4fae3" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-1fdf5a49-d955-4398-9878-7fcb3de4fae3" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa9903-fa0e-4a98-8012-9351424a0880]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:11 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 Jul 09 15:15:11 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:11 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.947s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Deleted volume successfully. Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8e541301-9168-4285-90d4-3cb598ed13ef tempest-VolumesTransfersTest-1461595186 None] Lock "cinder-a3c1863f-20e5-4653-ba7d-8e47337139b6-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Flow 'volume_create_manager' (d4d68736-3033-40dd-a17e-598ee31b6de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80adbc88-ec9c-432a-8087-3f4ebab1caa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80adbc88-ec9c-432a-8087-3f4ebab1caa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-190354071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e61fd7-f7b1-4326-b4d6-715bb9c94c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d05ec04511468ba75cff7af56319aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:12Z,use_quota=True,user_id='d5d769361eeb430fba25e077bbdc93f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49beb08d-235c-4da8-b96e-138820e85881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49beb08d-235c-4da8-b96e-138820e85881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14f9de6-2e0e-4fd6-9eaf-0e4f411a0ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14f9de6-2e0e-4fd6-9eaf-0e4f411a0ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e61fd7-f7b1-4326-b4d6-715bb9c94c75', 'volume_name': 'volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fb29a3-5764-4049-870b-06938b3e82c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fb29a3-5764-4049-870b-06938b3e82c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625f8840-1a9f-43ab-80d5-e6b24fc363d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Volume 70e61fd7-f7b1-4326-b4d6-715bb9c94c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75', 'volume_size': 1} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-190354071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e61fd7-f7b1-4326-b4d6-715bb9c94c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d05ec04511468ba75cff7af56319aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:12Z,use_quota=True,user_id='d5d769361eeb430fba25e077bbdc93f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Creating volume 70e61fd7-f7b1-4326-b4d6-715bb9c94c75 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:15:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:11 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75 1073741824 Jul 09 15:15:11 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:12 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3" returned: 0 in 1.013s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:12 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3 Jul 09 15:15:12 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:12 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75 1073741824" returned: 0 in 0.991s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:12 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75 Jul 09 15:15:12 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:12 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdf5a49-d955-4398-9878-7fcb3de4fae3" returned: 0 in 0.789s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-1fdf5a49-d955-4398-9878-7fcb3de4fae3" released by "delete_volume" :: held 1.901s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Created reservations ['d59d74fa-c304-49d8-806e-f15e6f6f945a', '7a38823d-87ab-4d82-b420-a731ef8e5acd', '8f75b7e2-e540-47e0-ba88-e967be09c50f', '405df886-3736-433f-a3e4-1a47af7df283'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:13 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:13 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-4ee4ce97-d108-4ec4-94eb-aaed103b7217 req-70725b20-98ae-488e-9e57-642b1200d8e0 tempest-AttachVolumeNegativeTest-1658335310 None] Terminate volume connection completed successfully. Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-4ee4ce97-d108-4ec4-94eb-aaed103b7217 req-70725b20-98ae-488e-9e57-642b1200d8e0 tempest-AttachVolumeNegativeTest-1658335310 None] Deleting attachment 79105f6c-5f0c-4dda-ad2f-76c8ba50bbd7. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:15:13 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75" returned: 0 in 0.955s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625f8840-1a9f-43ab-80d5-e6b24fc363d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9d7492-3010-4dcb-9294-fd2b281625f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Volume volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75 (70e61fd7-f7b1-4326-b4d6-715bb9c94c75): created successfully Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9d7492-3010-4dcb-9294-fd2b281625f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Flow 'volume_create_manager' (d4d68736-3033-40dd-a17e-598ee31b6de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-70a8d424-d332-4362-9106-318976ccfd10 tempest-VolumesTransfersTest-1155302584 None] Created volume successfully. Jul 09 15:15:14 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.897s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Deleted volume successfully. Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-85bdc259-84c5-4e81-a993-f7ab6e2c6d32 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-1fdf5a49-d955-4398-9878-7fcb3de4fae3-delete_volume" released by "delete_volume" :: held 14.900s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Flow 'volume_create_manager' (0d77dcda-f09e-4e95-a769-9814dd06d910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41644740-edd7-4548-8b34-8c1ed6ad250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41644740-edd7-4548-8b34-8c1ed6ad250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-910694922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfeb9d1420440e180dd1b3a75780e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:14Z,use_quota=True,user_id='d9692a3ebbf046d2b922b9cf59b75484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b247cdc-857e-4d59-b4be-7496f95698eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b247cdc-857e-4d59-b4be-7496f95698eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a130215-9cb4-498c-b779-c6c52327e0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a130215-9cb4-498c-b779-c6c52327e0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a', 'volume_name': 'volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050f649d-5798-4ca8-a63f-e5cd7ac5ee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050f649d-5798-4ca8-a63f-e5cd7ac5ee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2675b449-bded-439f-92ca-69f0ad0c53e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Volume 3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a', 'volume_size': 1} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-910694922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfeb9d1420440e180dd1b3a75780e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:14Z,use_quota=True,user_id='d9692a3ebbf046d2b922b9cf59b75484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Creating volume 3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:15:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:14 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a 1073741824 Jul 09 15:15:14 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Acquiring lock "cinder-70e61fd7-f7b1-4326-b4d6-715bb9c94c75-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Lock "cinder-70e61fd7-f7b1-4326-b4d6-715bb9c94c75-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Acquiring lock "cinder-quobyte-70e61fd7-f7b1-4326-b4d6-715bb9c94c75" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Lock "cinder-quobyte-70e61fd7-f7b1-4326-b4d6-715bb9c94c75" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae9cead-e475-44b1-9107-4f02c22e3282]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:15 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a 1073741824" returned: 0 in 1.172s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:15 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75 Jul 09 15:15:15 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:15 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a Jul 09 15:15:15 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:16 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75" returned: 0 in 0.833s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:16 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" returned: 0 in 0.733s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:16 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75 Jul 09 15:15:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2675b449-bded-439f-92ca-69f0ad0c53e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:16 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd4a990-dc8c-4cdc-a579-517cf1a509d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Volume volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a (3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a): created successfully Jul 09 15:15:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd4a990-dc8c-4cdc-a579-517cf1a509d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Flow 'volume_create_manager' (0d77dcda-f09e-4e95-a769-9814dd06d910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2eb5bea9-5a0f-4afd-9b78-99ede5e45a45 tempest-VolumesDeleteCascade-1207909645 None] Created volume successfully. Jul 09 15:15:17 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-70e61fd7-f7b1-4326-b4d6-715bb9c94c75" returned: 0 in 0.682s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Lock "cinder-quobyte-70e61fd7-f7b1-4326-b4d6-715bb9c94c75" released by "delete_volume" :: held 1.573s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Created reservations ['cf74d8e6-dc63-49fe-961a-3a02e4094152', '99b83224-60bf-44e1-9285-9f7d932ff785', '55f6741e-02a9-4d65-a698-a06e2b0ed803', '8f13c953-da2d-4ad3-99b3-ad35e573d313'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:17 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:17 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Creating offline snapshot 27b676cd-1577-4415-abb4-d60abc52d370 of volume 3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:15:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[de195b03-d83c-4ff5-a46f-b6e479600ab7]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:18 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a Jul 09 15:15:18 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:18 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.197s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:18 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Deleted volume successfully. Jul 09 15:15:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-dfb46f4c-eeac-4917-8a98-6dd4f236bfd9 tempest-VolumesTransfersTest-1461595186 None] Lock "cinder-70e61fd7-f7b1-4326-b4d6-715bb9c94c75-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:19 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" returned: 0 in 1.067s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:19 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 1G Jul 09 15:15:19 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ee7915a1-e355-4ce1-b3aa-ad7f5681414e tempest-GroupsV314Test-1500654492 None] Group tempest-GroupsV314Test-Group-878874248: creating Jul 09 15:15:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ee7915a1-e355-4ce1-b3aa-ad7f5681414e tempest-GroupsV314Test-1500654492 None] Group tempest-GroupsV314Test-Group-878874248: created successfully Jul 09 15:15:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ee7915a1-e355-4ce1-b3aa-ad7f5681414e tempest-GroupsV314Test-1500654492 None] Create group completed successfully. Jul 09 15:15:20 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 1G" returned: 0 in 0.961s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:20 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 Jul 09 15:15:20 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:20 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370" returned: 0 in 0.772s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:20 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 is being set with open permissions: ugo+rw Jul 09 15:15:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:20 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 Jul 09 15:15:20 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Flow 'volume_create_manager' (e5e1edbb-dda8-4ad1-b450-d1014959e4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5818708-a60a-4842-a089-e17f28bd1837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5818708-a60a-4842-a089-e17f28bd1837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1922264327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1adc63e-7fcf-48d3-a33c-a67448a041cd,host='devstack@QuobyteHD#QuobyteHD',id=a616fa81-0f3d-4d43-b2c3-77a430fb3b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270f12f72694afab0077c56307015d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:21Z,use_quota=True,user_id='6aa7b6aab0ba482daecbd822537c8268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25d302b5-7048-4e48-94e7-60eb2129f7e8),volume_type_id=25d302b5-7048-4e48-94e7-60eb2129f7e8)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225684f2-11e6-4ea5-9323-9b7ea6b4d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225684f2-11e6-4ea5-9323-9b7ea6b4d19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0a8ca5-c0cb-4c0f-9dab-637c17aa835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0a8ca5-c0cb-4c0f-9dab-637c17aa835c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a616fa81-0f3d-4d43-b2c3-77a430fb3b85', 'volume_name': 'volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90675788-aadb-4109-9c4a-aafa944b8e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90675788-aadb-4109-9c4a-aafa944b8e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8691e576-ff53-43d8-9252-6cfe9ff9372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Volume a616fa81-0f3d-4d43-b2c3-77a430fb3b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85', 'volume_size': 1} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:21 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370" returned: 0 in 0.761s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:21 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.info Jul 09 15:15:21 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:22 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.info" returned: 0 in 0.710s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:22 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.info is being set with open permissions: ugo+rw Jul 09 15:15:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:22 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.info Jul 09 15:15:22 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:23 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.info" returned: 0 in 0.688s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.080s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.656s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1adc63e-7fcf-48d3-a33c-a67448a041cd,created_at=2026-07-09T13:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1922264327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1adc63e-7fcf-48d3-a33c-a67448a041cd,host='devstack@QuobyteHD#QuobyteHD',id=a616fa81-0f3d-4d43-b2c3-77a430fb3b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9270f12f72694afab0077c56307015d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:21Z,use_quota=True,user_id='6aa7b6aab0ba482daecbd822537c8268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25d302b5-7048-4e48-94e7-60eb2129f7e8),volume_type_id=25d302b5-7048-4e48-94e7-60eb2129f7e8)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Creating volume a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:23 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 1073741824 Jul 09 15:15:23 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e0778841-c10a-4e10-b3ee-3b7151813dcf tempest-VolumesDeleteCascade-1207909645 None] Create snapshot completed successfully Jul 09 15:15:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Flow 'volume_create_manager' (2f2a8456-67a7-460a-a489-9690cc221649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855fe804-5f25-4a5a-8a2a-85117c4cb724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855fe804-5f25-4a5a-8a2a-85117c4cb724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-68235931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd31611-81f4-4dde-813f-4e68ae9306ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abfeb9d1420440e180dd1b3a75780e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=27b676cd-1577-4415-abb4-d60abc52d370,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:24Z,use_quota=True,user_id='d9692a3ebbf046d2b922b9cf59b75484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed46e38-e100-4964-a25a-b71211c25e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed46e38-e100-4964-a25a-b71211c25e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddac5f46-9af6-41ca-b7f4-0fb803ba70e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddac5f46-9af6-41ca-b7f4-0fb803ba70e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'acd31611-81f4-4dde-813f-4e68ae9306ec', 'volume_name': 'volume-acd31611-81f4-4dde-813f-4e68ae9306ec', 'volume_size': 1, 'snapshot_id': '27b676cd-1577-4415-abb4-d60abc52d370'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479e73e6-b1e2-43fb-99fa-9fc7e9a2889e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479e73e6-b1e2-43fb-99fa-9fc7e9a2889e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8142d304-f3b1-4eca-b240-b3637e32bd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Volume acd31611-81f4-4dde-813f-4e68ae9306ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-acd31611-81f4-4dde-813f-4e68ae9306ec', 'volume_size': 1, 'snapshot_id': '27b676cd-1577-4415-abb4-d60abc52d370'} Jul 09 15:15:24 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 1073741824" returned: 0 in 1.075s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:24 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 Jul 09 15:15:24 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "cinder-0c4f778a-e417-4fbd-80df-9e0fb58725ae-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-0c4f778a-e417-4fbd-80df-9e0fb58725ae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "cinder-quobyte-0c4f778a-e417-4fbd-80df-9e0fb58725ae" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-quobyte-0c4f778a-e417-4fbd-80df-9e0fb58725ae" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e98620-17e7-466f-b8ed-a276ddc5fc88]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:24 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae Jul 09 15:15:24 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:24 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85" returned: 0 in 0.726s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.758s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-27b676cd-1577-4415-abb4-d60abc52d370-acd31611-81f4-4dde-813f-4e68ae9306ec" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8691e576-ff53-43d8-9252-6cfe9ff9372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a074ef1f-3518-4886-877d-dbead331be35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-27b676cd-1577-4415-abb4-d60abc52d370-acd31611-81f4-4dde-813f-4e68ae9306ec" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Creating volume acd31611-81f4-4dde-813f-4e68ae9306ec from snapshot 27b676cd-1577-4415-abb4-d60abc52d370 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-acd31611-81f4-4dde-813f-4e68ae9306ec" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-acd31611-81f4-4dde-813f-4e68ae9306ec" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] snapshot: 27b676cd-1577-4415-abb4-d60abc52d370, volume: acd31611-81f4-4dde-813f-4e68ae9306ec, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:15:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Volume volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 (a616fa81-0f3d-4d43-b2c3-77a430fb3b85): created successfully Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a074ef1f-3518-4886-877d-dbead331be35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Flow 'volume_create_manager' (e5e1edbb-dda8-4ad1-b450-d1014959e4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c1fac599-f7f4-454a-847e-863f89ef6341 tempest-GroupsV314Test-1500654492 None] Created volume successfully. Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3777521e-d5c8-4142-99a6-c93fda955f8d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:25 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 Jul 09 15:15:25 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:25 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae" returned: 0 in 0.832s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:25 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae Jul 09 15:15:25 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:25 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370" returned: 0 in 0.812s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9d7ac5-ca9c-4a7b-a787-1327d9fd3ac3]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:26 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a Jul 09 15:15:26 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Flow 'volume_create_manager' (b056f03f-5898-4f23-bfeb-662d45340a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6f5ffc-6e44-4994-81a4-5b5c9c584f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6f5ffc-6e44-4994-81a4-5b5c9c584f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1038865810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769edfe9-5383-4417-b329-a689488a5c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71653afe20ea410b88b0644d564f838f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:26Z,use_quota=True,user_id='38ff1cc9aff042b88ae28be84cdca40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec03c62-65df-403e-a2d7-71f593f31340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec03c62-65df-403e-a2d7-71f593f31340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920f14c8-c635-477e-a97a-2e2f0b0aa27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920f14c8-c635-477e-a97a-2e2f0b0aa27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769edfe9-5383-4417-b329-a689488a5c2e', 'volume_name': 'volume-769edfe9-5383-4417-b329-a689488a5c2e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089c6619-b128-4344-a5c6-040dc82fc892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089c6619-b128-4344-a5c6-040dc82fc892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d206432c-fc9a-4f6a-8bf1-1d5fdce79755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:26 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Volume 769edfe9-5383-4417-b329-a689488a5c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769edfe9-5383-4417-b329-a689488a5c2e', 'volume_size': 1} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:26 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c4f778a-e417-4fbd-80df-9e0fb58725ae" returned: 0 in 0.734s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-quobyte-0c4f778a-e417-4fbd-80df-9e0fb58725ae" released by "delete_volume" :: held 1.606s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Created reservations ['8b8e711c-e610-4f7d-9567-18b86a65b1d7', '7d82cab4-4b78-4461-90e2-f7e52ed68844', '9f88c2f5-bb03-4538-9721-84584984bd21', '654ca684-dd98-42a6-85a3-eb7469c2659a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:26 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:26 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:26 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" returned: 0 in 0.800s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:26 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec Jul 09 15:15:26 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "cinder-8e6feb97-4a1a-4d12-91df-dafee419ea32-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-8e6feb97-4a1a-4d12-91df-dafee419ea32-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "cinder-quobyte-8e6feb97-4a1a-4d12-91df-dafee419ea32" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-quobyte-8e6feb97-4a1a-4d12-91df-dafee419ea32" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:27 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.713s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:27 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Deleted volume successfully. Jul 09 15:15:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3842e05-a6cd-4ca6-801d-c25690c9dbe4]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b93a5f9-f0bb-440a-9d99-e35629a449d8 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-0c4f778a-e417-4fbd-80df-9e0fb58725ae-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:27 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 Jul 09 15:15:27 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:28 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32" returned: 0 in 1.342s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:28 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32 Jul 09 15:15:28 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:30 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8e6feb97-4a1a-4d12-91df-dafee419ea32" returned: 0 in 1.605s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-quobyte-8e6feb97-4a1a-4d12-91df-dafee419ea32" released by "delete_volume" :: held 3.019s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Created reservations ['2ea9bf9e-0fd4-43b5-aa3e-0622c7cc0924', '4343b5d1-5673-44d2-abe6-cafcea72d509', 'f8c2aada-f493-4277-ac68-5926ef23d242', 'b85b797c-68d5-44ff-9020-dbca9c55621c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:30 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:30 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "cinder-54060709-7371-4ed8-ad5e-21e1a3ee156e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-54060709-7371-4ed8-ad5e-21e1a3ee156e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "cinder-quobyte-54060709-7371-4ed8-ad5e-21e1a3ee156e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-quobyte-54060709-7371-4ed8-ad5e-21e1a3ee156e" acquired by "delete_volume" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[176bc7b2-a0a9-49f3-96a7-75f2c8d0871c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:31 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e Jul 09 15:15:31 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:31 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.497s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:31 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Deleted volume successfully. Jul 09 15:15:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4fe9496f-17c1-4587-8fd6-6af0edafa589 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-8e6feb97-4a1a-4d12-91df-dafee419ea32-delete_volume" released by "delete_volume" :: held 4.931s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:32 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec" returned: 0 in 5.542s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0daf9e-0d8c-4a39-8d37-f50d5ad6641e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:32 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a Jul 09 15:15:32 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:32 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e" returned: 0 in 1.135s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:32 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e Jul 09 15:15:32 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:33 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" returned: 0 in 0.922s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:15:33 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Converted 1024.00 MB image at 184.72 MB/s Jul 09 15:15:33 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec is being set with open permissions: ugo+rw Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:33 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec Jul 09 15:15:33 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:33 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54060709-7371-4ed8-ad5e-21e1a3ee156e" returned: 0 in 0.655s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-quobyte-54060709-7371-4ed8-ad5e-21e1a3ee156e" released by "delete_volume" :: held 1.919s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Created reservations ['9c428e1a-67a0-4213-88bd-37305e62ba21', '6cf2747f-0dbf-4b6e-9a6b-99fef686e102', '7402fe73-51b1-4b14-af72-25aba34b61a0', 'f84be376-11ee-4201-8ed1-61fa8829e013'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:33 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:33 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:33 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec" returned: 0 in 0.674s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-acd31611-81f4-4dde-813f-4e68ae9306ec" released by "_copy_volume_from_snapshot" :: held 8.892s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-27b676cd-1577-4415-abb4-d60abc52d370-acd31611-81f4-4dde-813f-4e68ae9306ec" released by "_create_volume_from_snapshot" :: held 8.943s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.993s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.739s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1038865810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769edfe9-5383-4417-b329-a689488a5c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71653afe20ea410b88b0644d564f838f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:26Z,use_quota=True,user_id='38ff1cc9aff042b88ae28be84cdca40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Creating volume 769edfe9-5383-4417-b329-a689488a5c2e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:33 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:33 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e 1073741824 Jul 09 15:15:33 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8142d304-f3b1-4eca-b240-b3637e32bd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd31611-81f4-4dde-813f-4e68ae9306ec', 'volume_size': 1, 'snapshot_id': '27b676cd-1577-4415-abb4-d60abc52d370'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f463f2c8-d153-49e8-a171-5b492edbc76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Volume volume-acd31611-81f4-4dde-813f-4e68ae9306ec (acd31611-81f4-4dde-813f-4e68ae9306ec): created successfully Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f463f2c8-d153-49e8-a171-5b492edbc76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Flow 'volume_create_manager' (2f2a8456-67a7-460a-a489-9690cc221649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f501881f-f97b-4595-804f-ec24fa506cd6 tempest-VolumesDeleteCascade-1207909645 None] Created volume successfully. Jul 09 15:15:34 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.691s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:34 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Deleted volume successfully. Jul 09 15:15:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ecf3c7f2-a4f5-45f4-b0be-9e5be997de11 tempest-AttachVolumeNegativeTest-1658335310 None] Lock "cinder-54060709-7371-4ed8-ad5e-21e1a3ee156e-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:34 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e 1073741824" returned: 0 in 0.867s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:34 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e Jul 09 15:15:34 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Performing cascade delete. {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-27b676cd-1577-4415-abb4-d60abc52d370-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-27b676cd-1577-4415-abb4-d60abc52d370-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-27b676cd-1577-4415-abb4-d60abc52d370" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-27b676cd-1577-4415-abb4-d60abc52d370" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Deleting offline snapshot 27b676cd-1577-4415-abb4-d60abc52d370 of volume 3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] snapshot_file for this snap is: volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d544cb5f-e8dd-4f07-a509-9f0b27ff60f0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:35 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:35 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 Jul 09 15:15:35 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.166s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:35 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Cloning volume a616fa81-0f3d-4d43-b2c3-77a430fb3b85 to volume 93769d3b-77a1-4e19-b446-e47d0f351d0a Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d206432c-fc9a-4f6a-8bf1-1d5fdce79755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769edfe9-5383-4417-b329-a689488a5c2e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1412ced7-eff2-4f60-be8a-51dc8170e7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Volume volume-769edfe9-5383-4417-b329-a689488a5c2e (769edfe9-5383-4417-b329-a689488a5c2e): created successfully Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1412ced7-eff2-4f60-be8a-51dc8170e7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Flow 'volume_create_manager' (b056f03f-5898-4f23-bfeb-662d45340a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Creating offline snapshot d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 of volume a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:15:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b22b09cd-828d-4315-a80e-5eaf57914c37 tempest-VolumesTransfersV357Test-1187366898 None] Created volume successfully. Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[11932369-3bab-4663-92cb-cdd784e63f66]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:35 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 Jul 09 15:15:35 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:36 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370" returned: 0 in 0.906s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:15:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d37a33-6db8-4bc5-b2c8-dd573d38fc55]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:36 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a Jul 09 15:15:36 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:36 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85" returned: 0 in 1.080s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:36 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 1G Jul 09 15:15:36 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c918156c-6e0a-405b-bc7b-72f617efb1d4 tempest-VolumesTransfersV357Test-1261579004 None] Transfer volume completed successfully. Jul 09 15:15:37 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" returned: 0 in 0.908s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:37 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 Jul 09 15:15:37 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:37 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 1G" returned: 0 in 1.006s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:37 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 Jul 09 15:15:37 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:38 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370" returned: 0 in 0.871s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:38 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370 Jul 09 15:15:38 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Acquiring lock "cinder-769edfe9-5383-4417-b329-a689488a5c2e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Lock "cinder-769edfe9-5383-4417-b329-a689488a5c2e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Acquiring lock "cinder-quobyte-769edfe9-5383-4417-b329-a689488a5c2e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Lock "cinder-quobyte-769edfe9-5383-4417-b329-a689488a5c2e" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b36b944-f50d-4a4a-b06d-91ae34554721]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:38 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e Jul 09 15:15:38 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:38 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745" returned: 0 in 0.964s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:38 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:15:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:38 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 Jul 09 15:15:38 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:39 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a.27b676cd-1577-4415-abb4-d60abc52d370" returned: 0 in 0.817s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-27b676cd-1577-4415-abb4-d60abc52d370" released by "_delete_snapshot" :: held 3.642s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" released by "delete_snapshot" :: held 3.672s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Created reservations ['06630039-39fb-4246-8927-dd48f412865c', '729dd02c-f571-4163-b421-89fefac2316e', '7ece3a18-6138-43a4-b730-c78e84666384', 'ed0776de-21cb-41df-9063-350dae7dfcba'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Delete snapshot completed successfully. Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-27b676cd-1577-4415-abb4-d60abc52d370-delete_snapshot" released by "delete_snapshot" :: held 3.855s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Snapshots deleted, issuing volume delete {{(pid=86916) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab88c1fc-1b3c-43dc-a4f6-8ee2be3ce413]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:39 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a Jul 09 15:15:39 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:39 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745" returned: 0 in 0.743s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:39 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.info Jul 09 15:15:39 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:39 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e" returned: 0 in 1.030s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:39 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e Jul 09 15:15:39 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:40 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" returned: 0 in 0.873s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:40 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a Jul 09 15:15:40 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:40 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.info" returned: 0 in 0.744s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:40 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:40 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.info Jul 09 15:15:40 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:40 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-769edfe9-5383-4417-b329-a689488a5c2e" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Lock "cinder-quobyte-769edfe9-5383-4417-b329-a689488a5c2e" released by "delete_volume" :: held 1.844s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Created reservations ['3698f400-7635-4e02-86bd-b89b88ba103f', 'ed3c2f5d-b0b4-46e6-a975-b106b9a376b8', '349d0176-bc30-49b0-9319-92931e3bc2c6', 'fdeb04b3-4ce3-4a05-9eb6-793a90d9bd9a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:40 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:40 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:41 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" returned: 0 in 0.830s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a" released by "delete_volume" :: held 1.810s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:41 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.info" returned: 0 in 0.869s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Acquiring lock "cinder-quobyte-93769d3b-77a1-4e19-b446-e47d0f351d0a" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Lock "cinder-quobyte-93769d3b-77a1-4e19-b446-e47d0f351d0a" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] snapshot: d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745, volume: 93769d3b-77a1-4e19-b446-e47d0f351d0a, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Created reservations ['034e397a-e70d-4898-82fc-2ebc1f19c3ab', '51d2afd6-d5a9-4181-8220-8173b3ab0630', 'd6e5c554-6209-478d-979b-9210760a6908', 'ff94d896-4e0b-4dbc-a8cf-e64e91646417'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b543e1d-98a0-4e6a-a03a-c784dc3d07ec]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:41 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 Jul 09 15:15:41 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:41 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:41 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Flow 'volume_create_manager' (75f13452-b4bc-4bce-8837-d503b685facd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d887d18-6f30-4ade-a39b-54f244243c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d887d18-6f30-4ade-a39b-54f244243c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-743022613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ee80c4-4dfd-4a96-ad40-72739b69ce26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71653afe20ea410b88b0644d564f838f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:41Z,use_quota=True,user_id='38ff1cc9aff042b88ae28be84cdca40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052a139c-725f-45f4-900f-6fb8f295b7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052a139c-725f-45f4-900f-6fb8f295b7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ef0ec5-2ebe-45df-add0-98c974dad111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ef0ec5-2ebe-45df-add0-98c974dad111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ee80c4-4dfd-4a96-ad40-72739b69ce26', 'volume_name': 'volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1fea1b-58bb-41ec-bff8-898bc856cb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1fea1b-58bb-41ec-bff8-898bc856cb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd98bb04-2d60-4571-8901-d76e624b1edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Volume 28ee80c4-4dfd-4a96-ad40-72739b69ce26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26', 'volume_size': 1} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:41 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.079s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Deleted volume successfully. Jul 09 15:15:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e3943e9a-c805-4be7-87fe-9fda9139be57 tempest-VolumesTransfersV357Test-1223423065 None] Lock "cinder-769edfe9-5383-4417-b329-a689488a5c2e-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-57c14169-32b2-4a67-9d99-d2942d31e39f tempest-GroupSnapshotsTest-910622332 None] Group tempest-GroupSnapshotsTest-Group-1751085202: creating Jul 09 15:15:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-57c14169-32b2-4a67-9d99-d2942d31e39f tempest-GroupSnapshotsTest-910622332 None] Group tempest-GroupSnapshotsTest-Group-1751085202: created successfully Jul 09 15:15:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-57c14169-32b2-4a67-9d99-d2942d31e39f tempest-GroupSnapshotsTest-910622332 None] Create group completed successfully. Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-acd31611-81f4-4dde-813f-4e68ae9306ec-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-acd31611-81f4-4dde-813f-4e68ae9306ec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "cinder-quobyte-acd31611-81f4-4dde-813f-4e68ae9306ec" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-acd31611-81f4-4dde-813f-4e68ae9306ec" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f35cd7c-41d8-433f-9b21-d2e917062539]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:42 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745" returned: 0 in 0.973s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:15:42 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.811s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Deleted volume successfully. Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefffaf9-4325-4414-8e43-d22845a6530a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:42 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec Jul 09 15:15:42 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b397f1b6-8304-43dc-8356-908376e7eb1f tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-3aecf8df-46ba-45c0-a3ae-a6bdc6f6997a-delete_volume" released by "delete_volume" :: held 7.023s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:42 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 Jul 09 15:15:42 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:42 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec" returned: 0 in 0.785s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:43 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec Jul 09 15:15:43 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:43 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85" returned: 0 in 0.789s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:43 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a Jul 09 15:15:43 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:43 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=114,cinder:UPDATE=158,cinder:INSERT=38,cinder:DELETE=15 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-acd31611-81f4-4dde-813f-4e68ae9306ec" returned: 0 in 0.735s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-quobyte-acd31611-81f4-4dde-813f-4e68ae9306ec" released by "delete_volume" :: held 1.577s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Flow 'volume_create_manager' (4d5f8603-3d9a-4f22-a785-e49e69a07166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c474d65-97d6-42c4-80b3-f1f88a59d263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c474d65-97d6-42c4-80b3-f1f88a59d263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906218464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec8a6641-660a-443d-b821-1784f81a1b0a,host='devstack@QuobyteHD#QuobyteHD',id=dbc41424-7c09-48ec-bccf-6762c326af1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0150f1018dd6423a850d18dd12e4a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:44Z,use_quota=True,user_id='a9f578b18bae40a0b683232981ec4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e621105-e1c6-41fe-9812-ecdb7b44fe14),volume_type_id=3e621105-e1c6-41fe-9812-ecdb7b44fe14)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0ec68c-9e09-493b-8a22-71a9dc1c27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0ec68c-9e09-493b-8a22-71a9dc1c27ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de48556-8900-4c66-8648-bc02ce97fd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de48556-8900-4c66-8648-bc02ce97fd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc41424-7c09-48ec-bccf-6762c326af1f', 'volume_name': 'volume-dbc41424-7c09-48ec-bccf-6762c326af1f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47327a0c-1184-4869-a210-4452bfe456b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47327a0c-1184-4869-a210-4452bfe456b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd2a41a-7c15-4aa0-bd9b-6b74fe469fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Volume dbc41424-7c09-48ec-bccf-6762c326af1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc41424-7c09-48ec-bccf-6762c326af1f', 'volume_size': 1} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Created reservations ['8de4e800-0dd2-4929-acbb-30836d8c1a97', '4a17963a-4ccf-4959-b1d1-b3b09d74fb53', '0b87a987-ec29-408f-a5c7-bf4a9d24b03f', '49ea6592-955c-4537-8b8c-6a1b5c280d4a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:43 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:43 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:45 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.589s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:45 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Deleted volume successfully. Jul 09 15:15:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b140cd65-acd2-4a53-8b55-3cee3f9c8030 tempest-VolumesDeleteCascade-1207909645 None] Lock "cinder-acd31611-81f4-4dde-813f-4e68ae9306ec-delete_volume" released by "delete_volume" :: held 3.531s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:15:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:47 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:47 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:49 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a" returned: 0 in 5.958s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7ec6c3-b914-4bbd-bc99-55d56c5a67c7]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:49 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.376s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:49 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:49 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:15:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 8 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:15:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:15:49 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 Jul 09 15:15:49 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:50 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85" returned: 0 in 0.994s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:15:50 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Converted 1024.00 MB image at 171.82 MB/s Jul 09 15:15:50 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:50 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a Jul 09 15:15:50 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:50 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a" returned: 0 in 0.647s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Lock "cinder-quobyte-93769d3b-77a1-4e19-b446-e47d0f351d0a" released by "_copy_volume_from_snapshot" :: held 9.483s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=147,cinder:DELETE=9,cinder:SELECT=142,cinder:INSERT=36 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Acquiring lock "cinder-quobyte-d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Lock "cinder-quobyte-d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Deleting offline snapshot d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 of volume a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] snapshot_file for this snap is: volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[42616f28-932c-486c-992d-0bbfece59542]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:50 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 Jul 09 15:15:50 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Flow 'volume_create_manager' (5ed124fe-ad63-4abc-8380-7912dd7db853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8bdcc6d-3cf6-400e-a2a6-d7c6054535a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:51 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745" returned: 0 in 0.810s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8bdcc6d-3cf6-400e-a2a6-d7c6054535a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1091117214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4105d25cdf9d439e850416ed99cb0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:52Z,use_quota=True,user_id='f655faebb5654e47957cf33d7ad9313b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37366657-b3e4-4c5d-953b-2ebb8a8e7f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37366657-b3e4-4c5d-953b-2ebb8a8e7f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f5de84-c4d3-43da-8385-9589c2a139a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f5de84-c4d3-43da-8385-9589c2a139a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390', 'volume_name': 'volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22857f4b-f61c-4c92-86c1-58e172b05923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22857f4b-f61c-4c92-86c1-58e172b05923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73b69cf-f6ae-4f36-81d1-7352ebfd2f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Volume 48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390', 'volume_size': 1} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc0b71d-8ff5-475a-80e8-6941033d5562]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:51 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 Jul 09 15:15:51 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:52 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85" returned: 0 in 0.748s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:52 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 Jul 09 15:15:52 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:53 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745" returned: 0 in 0.726s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:53 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745 Jul 09 15:15:53 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:53 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85.d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745" returned: 0 in 0.633s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Lock "cinder-quobyte-d5a5c1cc-adcc-4d1d-b46b-23f6b64c4745" released by "_delete_snapshot" :: held 3.042s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.250s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.218s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-743022613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ee80c4-4dfd-4a96-ad40-72739b69ce26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71653afe20ea410b88b0644d564f838f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:41Z,use_quota=True,user_id='38ff1cc9aff042b88ae28be84cdca40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Creating volume 28ee80c4-4dfd-4a96-ad40-72739b69ce26 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:15:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:53 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26 1073741824 Jul 09 15:15:53 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9616914c-20ef-4b5a-a7ea-59c000d95082 tempest-GroupsV314Test-1500654492 None] Create group from source-group-f1adc63e-7fcf-48d3-a33c-a67448a041cd completed successfully. Jul 09 15:15:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Acquiring lock "cinder-quobyte-93769d3b-77a1-4e19-b446-e47d0f351d0a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Lock "cinder-quobyte-93769d3b-77a1-4e19-b446-e47d0f351d0a" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aa0a10-09b0-4146-8aec-fbb7c8636008]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:54 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26 1073741824" returned: 0 in 0.868s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:54 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26 Jul 09 15:15:54 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:54 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a Jul 09 15:15:54 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:55 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26" returned: 0 in 0.671s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:55 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.584s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ec8a6641-660a-443d-b821-1784f81a1b0a,created_at=2026-07-09T13:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906218464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec8a6641-660a-443d-b821-1784f81a1b0a,host='devstack@QuobyteHD#QuobyteHD',id=dbc41424-7c09-48ec-bccf-6762c326af1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0150f1018dd6423a850d18dd12e4a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:44Z,use_quota=True,user_id='a9f578b18bae40a0b683232981ec4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e621105-e1c6-41fe-9812-ecdb7b44fe14),volume_type_id=3e621105-e1c6-41fe-9812-ecdb7b44fe14)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Creating volume dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a" returned: 0 in 0.795s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:55 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f 1073741824 Jul 09 15:15:55 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd98bb04-2d60-4571-8901-d76e624b1edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc1627f-0633-419c-bc55-67135afe76c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:55 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a Jul 09 15:15:55 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:55 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Volume volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26 (28ee80c4-4dfd-4a96-ad40-72739b69ce26): created successfully Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc1627f-0633-419c-bc55-67135afe76c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:55 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Flow 'volume_create_manager' (75f13452-b4bc-4bce-8837-d503b685facd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-63836d72-f208-4fd9-99ae-175500fd2c97 tempest-VolumesTransfersV357Test-1187366898 None] Created volume successfully. Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Acquiring lock "cinder-28ee80c4-4dfd-4a96-ad40-72739b69ce26-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Lock "cinder-28ee80c4-4dfd-4a96-ad40-72739b69ce26-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Acquiring lock "cinder-quobyte-28ee80c4-4dfd-4a96-ad40-72739b69ce26" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Lock "cinder-quobyte-28ee80c4-4dfd-4a96-ad40-72739b69ce26" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5154bbe8-cc1a-405b-ac47-009a5e6ba535]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:56 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-93769d3b-77a1-4e19-b446-e47d0f351d0a" returned: 0 in 0.864s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Lock "cinder-quobyte-93769d3b-77a1-4e19-b446-e47d0f351d0a" released by "delete_volume" :: held 1.723s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:56 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26 Jul 09 15:15:56 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:56 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f 1073741824" returned: 0 in 0.944s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Created reservations ['78071f84-c978-464c-a2ff-85902dcb3f71'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:56 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f Jul 09 15:15:56 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:56 devstack cinder-volume[86916]: WARNING cinder.quota [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-469671652 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-469671652, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:15:56 devstack cinder-volume[86916]: WARNING cinder.quota [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-469671652 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-469671652, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Created reservations ['96b84907-fdc9-467f-bfe4-786930746c1a', '2d5c8a0b-19fa-4695-b222-5ffa8b729ab5', '39d57d3b-ced3-47fc-a6be-7d85c5735aa9', '079bfd08-5aa7-40c1-af17-369e73eddc45'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:56 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:56 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:57 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f" returned: 0 in 0.703s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.479s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1091117214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4105d25cdf9d439e850416ed99cb0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:15:52Z,use_quota=True,user_id='f655faebb5654e47957cf33d7ad9313b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Creating volume 48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:15:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:57 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:57 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 1073741824 Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26" returned: 0 in 0.952s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:57 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd2a41a-7c15-4aa0-bd9b-6b74fe469fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc41424-7c09-48ec-bccf-6762c326af1f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bf189a-cf0b-4232-81b5-527132f15614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:57 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26 Jul 09 15:15:57 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Volume volume-dbc41424-7c09-48ec-bccf-6762c326af1f (dbc41424-7c09-48ec-bccf-6762c326af1f): created successfully Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bf189a-cf0b-4232-81b5-527132f15614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Flow 'volume_create_manager' (4d5f8603-3d9a-4f22-a785-e49e69a07166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-328f1088-a02b-44a9-bfec-9ba07a919945 tempest-GroupSnapshotsTest-910622332 None] Created volume successfully. Jul 09 15:15:57 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.860s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-db0b7f50-43a2-4102-a236-67b9f77fb54f tempest-GroupsV314Test-1500654492 None] Delete group completed successfully. Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Acquiring lock "cinder-quobyte-a616fa81-0f3d-4d43-b2c3-77a430fb3b85" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Lock "cinder-quobyte-a616fa81-0f3d-4d43-b2c3-77a430fb3b85" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d23810d-1be7-4c69-a023-0de6033ce327]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:57 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 Jul 09 15:15:57 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:57 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28ee80c4-4dfd-4a96-ad40-72739b69ce26" returned: 0 in 0.744s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Lock "cinder-quobyte-28ee80c4-4dfd-4a96-ad40-72739b69ce26" released by "delete_volume" :: held 1.742s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Created reservations ['9936f13c-1208-463c-988d-ceec646c1145', '48b2dc09-7be7-4c55-8228-64035fb2d5a3', '072667ac-3b6b-4518-a9bb-e8ed46af2d73', '9f1a245e-4537-412e-9a7f-0eeea9655dea'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:58 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:58 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 1073741824" returned: 0 in 0.959s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:58 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:58 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 Jul 09 15:15:58 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:58 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85" returned: 0 in 0.878s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:58 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85 Jul 09 15:15:58 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] GroupSnapshot 2e955230-9875-4fd3-975f-00c6b1aa597f: creating. Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Group snapshot 2e955230-9875-4fd3-975f-00c6b1aa597f: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:58 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.877s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:58 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:15:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Deleted volume successfully. Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9bc1b0ce-436b-4aa6-b55d-42fe8ad8bea0 tempest-VolumesTransfersV357Test-1223423065 None] Lock "cinder-28ee80c4-4dfd-4a96-ad40-72739b69ce26-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:59 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390" returned: 0 in 0.955s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.317s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Creating offline snapshot 3b464070-41d1-44e8-bd27-276f196cf583 of volume dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73b69cf-f6ae-4f36-81d1-7352ebfd2f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2c2081-d47c-4058-8be4-0531a89d55bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d13457-a895-4662-84d5-990caab39ef9]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Volume volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 (48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390): created successfully Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2c2081-d47c-4058-8be4-0531a89d55bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Flow 'volume_create_manager' (5ed124fe-ad63-4abc-8380-7912dd7db853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:15:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4ea7cc7c-2bef-46f4-baf0-5ef69c673737 tempest-VolumesTransfersV355Test-1973292218 None] Created volume successfully. Jul 09 15:15:59 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f Jul 09 15:15:59 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:59 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a616fa81-0f3d-4d43-b2c3-77a430fb3b85" returned: 0 in 0.904s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Lock "cinder-quobyte-a616fa81-0f3d-4d43-b2c3-77a430fb3b85" released by "delete_volume" :: held 1.852s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Created reservations ['f79d2e8a-6c85-45e6-b200-3836d2c379d2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Created reservations ['ce095880-34aa-4f28-a717-fcf7ebc01f79', 'b76b5397-4f77-42fa-a5aa-f0405475c735', '2005a28c-a20e-477c-9d55-0f9972de5b75', 'd970e195-11f6-4f61-8195-53d128d7fe0d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:15:59 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:15:59 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:15:59 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f" returned: 0 in 0.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:15:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:00 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 1G Jul 09 15:16:00 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:00 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.932s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:00 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4f35f801-90d0-4dbc-bcd4-a2b3045dacf6 tempest-GroupsV314Test-1500654492 None] Delete group completed successfully. Jul 09 15:16:01 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 1G" returned: 0 in 1.123s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc41424-7c09-48ec-bccf-6762c326af1f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:01 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc41424-7c09-48ec-bccf-6762c326af1f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 Jul 09 15:16:01 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aecfc1a7-2dd0-4063-b209-3a8b6921818c tempest-VolumesTransfersV355Test-104803442 None] Transfer volume completed successfully. Jul 09 15:16:02 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc41424-7c09-48ec-bccf-6762c326af1f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583" returned: 0 in 0.912s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:02 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:16:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:02 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 Jul 09 15:16:02 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Acquiring lock "cinder-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Lock "cinder-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Acquiring lock "cinder-quobyte-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Lock "cinder-quobyte-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a687919-a81b-4596-a86a-681a025cd26f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:02 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 Jul 09 15:16:02 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:02 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583" returned: 0 in 0.865s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:02 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.info Jul 09 15:16:02 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:03 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.info" returned: 0 in 0.719s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:03 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:16:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:03 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390" returned: 0 in 0.970s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:03 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.info Jul 09 15:16:03 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:03 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390 Jul 09 15:16:03 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:04 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.info" returned: 0 in 0.809s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.375s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:04 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390" returned: 0 in 0.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Lock "cinder-quobyte-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390" released by "delete_volume" :: held 1.841s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Created reservations ['f669515d-b239-4895-b3c3-ce8382b5705d', '57f7ffb7-6b5f-478a-baf1-e1f3db329773', '610ea21c-f849-4bd2-a868-2924c3d2629c', '2b667b51-a5fc-44ae-9a2f-049310b15669'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-86aafeac-c74b-4802-860c-e452491e28a4 tempest-GroupSnapshotsTest-910622332 None] group_snapshot 2e955230-9875-4fd3-975f-00c6b1aa597f: created successfully Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:04 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:16:04 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:05 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.795s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Deleted volume successfully. Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a4543074-612f-41ae-9fa9-0a269e3ea86e tempest-VolumesTransfersV355Test-776458605 None] Lock "cinder-48a3da5f-f0c9-4fd9-9310-8ac0bd0c7390-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Flow 'volume_create_manager' (40fd6400-bcb5-4421-b6f3-603409364813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445c11de-152d-403b-a73c-b05053360815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445c11de-152d-403b-a73c-b05053360815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1630755000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d26312-e471-4d16-bbac-5ad8335dccf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4105d25cdf9d439e850416ed99cb0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:06Z,use_quota=True,user_id='f655faebb5654e47957cf33d7ad9313b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688d9447-f83a-4e44-8796-7c5d9292f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688d9447-f83a-4e44-8796-7c5d9292f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42635904-4ff9-4e64-80a4-7090b8cd3a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42635904-4ff9-4e64-80a4-7090b8cd3a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d26312-e471-4d16-bbac-5ad8335dccf4', 'volume_name': 'volume-05d26312-e471-4d16-bbac-5ad8335dccf4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f6a5a8-5705-43bb-8c8a-3a4ce7e69e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f6a5a8-5705-43bb-8c8a-3a4ce7e69e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67048b0e-1cf9-4dad-a342-eb294c592861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Volume 05d26312-e471-4d16-bbac-5ad8335dccf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d26312-e471-4d16-bbac-5ad8335dccf4', 'volume_size': 1} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1630755000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d26312-e471-4d16-bbac-5ad8335dccf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4105d25cdf9d439e850416ed99cb0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:06Z,use_quota=True,user_id='f655faebb5654e47957cf33d7ad9313b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Creating volume 05d26312-e471-4d16-bbac-5ad8335dccf4 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:05 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:16:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:05 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4 1073741824 Jul 09 15:16:05 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:06 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4 1073741824" returned: 0 in 1.021s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:06 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4 Jul 09 15:16:06 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Flow 'volume_create_manager' (42709927-9950-428f-9b1d-a30129c79a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d901f4-0cac-4f4f-9696-1645a987a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d901f4-0cac-4f4f-9696-1645a987a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1588284816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12dc9a05-1191-47d9-8369-d6915e6aa2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d254c086d04ffca8784e2c4aab4d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:07Z,use_quota=True,user_id='5ede6a10839b48b6a2940a8e644f9629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d603a3a-e0df-4c8c-bd5f-c851babe7aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d603a3a-e0df-4c8c-bd5f-c851babe7aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998c3234-928c-4ca4-99d5-62d4ae9198ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:16:07 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4" returned: 0 in 0.732s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.165s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-3b464070-41d1-44e8-bd27-276f196cf583-a1ee3c29-4253-4318-964f-b8bc7de98791" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67048b0e-1cf9-4dad-a342-eb294c592861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d26312-e471-4d16-bbac-5ad8335dccf4', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e9c7c4-377b-4757-909d-d92c068af28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-3b464070-41d1-44e8-bd27-276f196cf583-a1ee3c29-4253-4318-964f-b8bc7de98791" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Creating volume a1ee3c29-4253-4318-964f-b8bc7de98791 from snapshot 3b464070-41d1-44e8-bd27-276f196cf583 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-a1ee3c29-4253-4318-964f-b8bc7de98791" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Volume volume-05d26312-e471-4d16-bbac-5ad8335dccf4 (05d26312-e471-4d16-bbac-5ad8335dccf4): created successfully Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e9c7c4-377b-4757-909d-d92c068af28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Flow 'volume_create_manager' (40fd6400-bcb5-4421-b6f3-603409364813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-a1ee3c29-4253-4318-964f-b8bc7de98791" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] snapshot: 3b464070-41d1-44e8-bd27-276f196cf583, volume: a1ee3c29-4253-4318-964f-b8bc7de98791, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7f28b642-9f5f-4410-80c8-9b29b8b0b5f6 tempest-VolumesTransfersV355Test-1973292218 None] Created volume successfully. Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf28922-9a51-42be-bd2c-557aca17d20a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:07 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 Jul 09 15:16:07 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998c3234-928c-4ca4-99d5-62d4ae9198ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12dc9a05-1191-47d9-8369-d6915e6aa2cb', 'volume_name': 'volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278ebb1b-4447-4571-81c6-e68c1c71d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278ebb1b-4447-4571-81c6-e68c1c71d789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b4fe2f-4fca-487f-88b0-6c9f7f06d5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Volume 12dc9a05-1191-47d9-8369-d6915e6aa2cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Trying to clone 12dc9a05-1191-47d9-8369-d6915e6aa2cb from image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:16:08 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Image download 20.69 MB at 20.69 MB/s Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e377d4cf-afaf-4423-9bf7-2904de0afe59]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Acquiring lock "cinder-05d26312-e471-4d16-bbac-5ad8335dccf4-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Lock "cinder-05d26312-e471-4d16-bbac-5ad8335dccf4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:08 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD Jul 09 15:16:08 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Acquiring lock "cinder-quobyte-05d26312-e471-4d16-bbac-5ad8335dccf4" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Lock "cinder-quobyte-05d26312-e471-4d16-bbac-5ad8335dccf4" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8c71dc-2e41-4534-ab0b-eeb4fd3dd309]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:08 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583" returned: 0 in 1.100s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbc41424-7c09-48ec-bccf-6762c326af1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdfd0a5-623c-422b-8543-2102b253bcf2]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:08 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4 Jul 09 15:16:08 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:08 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f Jul 09 15:16:09 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:09 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:09 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Temporary image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 is fetched for user 5ede6a10839b48b6a2940a8e644f9629. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:16:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aa3a8d-5bc3-4aa5-8940-3f8ab0460b43]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:09 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD Jul 09 15:16:09 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:09 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4" returned: 0 in 0.969s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:09 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4 Jul 09 15:16:09 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:09 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f" returned: 0 in 1.027s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:09 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:16:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:09 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 Jul 09 15:16:09 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:10 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD" returned: 0 in 0.906s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:10 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-05d26312-e471-4d16-bbac-5ad8335dccf4" returned: 0 in 0.796s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Lock "cinder-quobyte-05d26312-e471-4d16-bbac-5ad8335dccf4" released by "delete_volume" :: held 1.823s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Created reservations ['82a84af7-8455-4496-b3c8-c4600c3d8168', 'd8aaed80-5758-484d-a41a-3e11b82a7649', '9b0953e0-73f2-47e3-acd1-1ff5f8cfb74b', '364b810e-a727-4034-85a3-010a478bfcec'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:10 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:16:10 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:12 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:12 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Deleted volume successfully. Jul 09 15:16:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e0ff409-b711-479d-bfdb-44cb1ecbe640 tempest-VolumesTransfersV355Test-776458605 None] Lock "cinder-05d26312-e471-4d16-bbac-5ad8335dccf4-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:15 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791" returned: 0 in 5.956s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5526182-ce39-4802-810c-0d52968136bf]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:15 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f Jul 09 15:16:15 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:16 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f" returned: 0 in 1.018s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:16 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:16:16 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Converted 1024.00 MB image at 171.90 MB/s Jul 09 15:16:16 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:16:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:16 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 Jul 09 15:16:16 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:17 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791" returned: 0 in 0.810s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-a1ee3c29-4253-4318-964f-b8bc7de98791" released by "_copy_volume_from_snapshot" :: held 10.036s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-3b464070-41d1-44e8-bd27-276f196cf583-a1ee3c29-4253-4318-964f-b8bc7de98791" released by "_create_volume_from_snapshot" :: held 10.099s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.127s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.283s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1588284816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12dc9a05-1191-47d9-8369-d6915e6aa2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d254c086d04ffca8784e2c4aab4d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:07Z,use_quota=True,user_id='5ede6a10839b48b6a2940a8e644f9629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Creating volume 12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:17 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:16:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:17 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb 1073741824 Jul 09 15:16:17 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f3ceaac0-0f3c-4ae2-934d-4716bc5ec8b7 tempest-GroupSnapshotsTest-910622332 None] Create group from source-snapshot-2e955230-9875-4fd3-975f-00c6b1aa597f completed successfully. Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Flow 'volume_create_manager' (d4ae2d1d-718d-403f-b713-9a3d49e73bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bb267e-8d39-4825-a9b7-da6408fac518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bb267e-8d39-4825-a9b7-da6408fac518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2047176159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2204c57-ad94-4d03-8340-c66c1f7c4b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7161a38c554c99be612a3b4323a5a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:18Z,use_quota=True,user_id='ef9c4217f58645b69ae236eb07362dc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb8099f-9db8-4ffd-8ca6-3087c3c1c08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb8099f-9db8-4ffd-8ca6-3087c3c1c08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94af0214-504c-4971-b877-2c8faa3a60a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94af0214-504c-4971-b877-2c8faa3a60a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2204c57-ad94-4d03-8340-c66c1f7c4b0c', 'volume_name': 'volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ad8491-cffd-49d6-b339-dc3f701bb09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ad8491-cffd-49d6-b339-dc3f701bb09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d1c3f3-f76d-47f7-8934-003d1881e6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Volume b2204c57-ad94-4d03-8340-c66c1f7c4b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c', 'volume_size': 1} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:18 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb 1073741824" returned: 0 in 0.902s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:18 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb Jul 09 15:16:18 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:19 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb" returned: 0 in 0.680s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.079s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2047176159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2204c57-ad94-4d03-8340-c66c1f7c4b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7161a38c554c99be612a3b4323a5a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:18Z,use_quota=True,user_id='ef9c4217f58645b69ae236eb07362dc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Creating volume b2204c57-ad94-4d03-8340-c66c1f7c4b0c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:19 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:19 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c 1073741824 Jul 09 15:16:19 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Attempting download of bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}])) to volume 12dc9a05-1191-47d9-8369-d6915e6aa2cb. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-a1ee3c29-4253-4318-964f-b8bc7de98791" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-a1ee3c29-4253-4318-964f-b8bc7de98791" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd1e6ee-8990-41d2-8173-d07e594aba18]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_xevpq3fs {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdac24e-78fe-429b-9e89-968ba255cd18]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:19 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_xevpq3fs Jul 09 15:16:19 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:19 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 Jul 09 15:16:19 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:20 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_xevpq3fs" returned: 0 in 0.983s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_xevpq3fs {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:20 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791" returned: 0 in 0.985s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:20 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791 Jul 09 15:16:20 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:20 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c 1073741824" returned: 0 in 1.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:20 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_xevpq3fs Jul 09 15:16:20 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:20 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c Jul 09 15:16:20 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:21 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a1ee3c29-4253-4318-964f-b8bc7de98791" returned: 0 in 0.947s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-a1ee3c29-4253-4318-964f-b8bc7de98791" released by "delete_volume" :: held 2.007s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:21 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c" returned: 0 in 0.916s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:21 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_xevpq3fs" returned: 1 in 1.064s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_xevpq3fs' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0dc8ad-f626-4d05-b4fb-672b66d377ab]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d1c3f3-f76d-47f7-8934-003d1881e6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1557f17-3dcd-4778-b076-d5a5cef99e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Volume volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c (b2204c57-ad94-4d03-8340-c66c1f7c4b0c): created successfully Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1557f17-3dcd-4778-b076-d5a5cef99e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Flow 'volume_create_manager' (d4ae2d1d-718d-403f-b713-9a3d49e73bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['767cfe3c-07c4-425b-8ffc-ad25a05ca1d1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3020ad50-1ee6-428d-95b3-0c32f438ce39 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Created volume successfully. Jul 09 15:16:21 devstack cinder-volume[86916]: WARNING cinder.quota [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-977052473 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-977052473, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:16:21 devstack cinder-volume[86916]: WARNING cinder.quota [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-977052473 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-977052473, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['f95afaa8-60d4-4141-964f-a456b3d07e42', '00072ce1-e66f-47fb-81b8-1ee69ece4bd0', '924a2865-998f-4e5f-8ddf-c5917adceda1', '086603aa-0178-4e8f-af61-6ec5a2e6b16e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:21 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD Jul 09 15:16:21 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:21 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:16:21 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] group_snapshot 2e955230-9875-4fd3-975f-00c6b1aa597f: deleting Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] group_snapshot 2e955230-9875-4fd3-975f-00c6b1aa597f: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-dbc41424-7c09-48ec-bccf-6762c326af1f" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-dbc41424-7c09-48ec-bccf-6762c326af1f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-3b464070-41d1-44e8-bd27-276f196cf583" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-3b464070-41d1-44e8-bd27-276f196cf583" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Deleting offline snapshot 3b464070-41d1-44e8-bd27-276f196cf583 of volume dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] snapshot_file for this snap is: volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f663e41-9032-4b15-8034-5338ba7993c7]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:22 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD" returned: 0 in 1.030s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 was qcow2, converting to raw {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:22 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 Jul 09 15:16:22 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:22 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb Jul 09 15:16:22 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Acquiring lock "cinder-b2204c57-ad94-4d03-8340-c66c1f7c4b0c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "cinder-b2204c57-ad94-4d03-8340-c66c1f7c4b0c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:22 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.973s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-725cec00-1895-4a1e-a0ae-7d2cf5659d60 tempest-GroupSnapshotsTest-910622332 None] Delete group completed successfully. Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Acquiring lock "cinder-quobyte-b2204c57-ad94-4d03-8340-c66c1f7c4b0c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "cinder-quobyte-b2204c57-ad94-4d03-8340-c66c1f7c4b0c" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b09e19d-9651-434d-b7e4-e87437796968]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:23 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c Jul 09 15:16:23 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:23 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583" returned: 0 in 0.964s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbc41424-7c09-48ec-bccf-6762c326af1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:16:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eb9a12-f8cd-4292-bb3e-8e861f5f66ee]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:23 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f Jul 09 15:16:23 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:23 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c" returned: 0 in 0.991s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:23 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c Jul 09 15:16:23 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:24 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f" returned: 0 in 1.013s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:24 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 Jul 09 15:16:24 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:24 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2204c57-ad94-4d03-8340-c66c1f7c4b0c" returned: 0 in 0.931s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "cinder-quobyte-b2204c57-ad94-4d03-8340-c66c1f7c4b0c" released by "delete_volume" :: held 1.989s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Created reservations ['7c2f2947-054b-4cf1-b442-5005799be3a2', 'cd029f9f-5d66-4106-8821-6b34ed2b67eb', 'd3e634b5-6273-48cf-a35e-fc1b6bc4d4bf', '6f43a75c-762b-412d-b5dd-224432ba8ba2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:25 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb" returned: 0 in 2.401s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_bukdawokdevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:16:25 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Converted 112.00 MB image at 46.63 MB/s Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:25 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb 1G Jul 09 15:16:25 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:25 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:16:25 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:25 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583" returned: 0 in 0.926s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:25 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583 Jul 09 15:16:25 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:25 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:25 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Flow 'volume_create_manager' (0c362e0f-dfe8-468e-8d7f-2a2a4048b4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7b2d65-b061-4b43-9f29-0d87ff0bed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb 1G" returned: 0 in 0.974s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7b2d65-b061-4b43-9f29-0d87ff0bed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-980258633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ce8b5b-14c2-4090-80e2-9f0ce95ed781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7161a38c554c99be612a3b4323a5a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:26Z,use_quota=True,user_id='ef9c4217f58645b69ae236eb07362dc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7458a60f-1cee-465d-becf-0fd5e687e231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7458a60f-1cee-465d-becf-0fd5e687e231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6197254-1983-42da-bde3-a51154d9990b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6197254-1983-42da-bde3-a51154d9990b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ce8b5b-14c2-4090-80e2-9f0ce95ed781', 'volume_name': 'volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d441ce1-864c-47d2-809a-c07812b33896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d441ce1-864c-47d2-809a-c07812b33896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337472e9-fad9-41b9-b498-9b14113c30d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:26 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Volume b2ce8b5b-14c2-4090-80e2-9f0ce95ed781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781', 'volume_size': 1} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-980258633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ce8b5b-14c2-4090-80e2-9f0ce95ed781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7161a38c554c99be612a3b4323a5a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:26Z,use_quota=True,user_id='ef9c4217f58645b69ae236eb07362dc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Creating volume b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:26 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a691f07c-e9cb-4827-b193-aff049d6db53]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:26 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.021s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:26 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 1073741824 Jul 09 15:16:26 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Deleted volume successfully. Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-00f6e1bb-a195-413b-b78d-c642860da1e9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "cinder-b2204c57-ad94-4d03-8340-c66c1f7c4b0c-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:26 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb Jul 09 15:16:26 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:26 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f.3b464070-41d1-44e8-bd27-276f196cf583" returned: 0 in 1.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-3b464070-41d1-44e8-bd27-276f196cf583" released by "_delete_snapshot" :: held 4.344s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-dbc41424-7c09-48ec-bccf-6762c326af1f" released by "delete_snapshot" :: held 4.392s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:26 devstack cinder-volume[86916]: WARNING cinder.quota [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-977052473 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-977052473, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:16:26 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['8387b4bb-1101-4083-ae7d-8d1ca3ebf614', 'b0fead00-3eac-470c-8d09-2e71d9c145f2', '13d319d5-c114-4b8f-a07c-5f91d76555fe', '507126ad-d3a4-40f2-a5b5-07b82a273917'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-987d5afc-7666-4ec2-a833-e4a648053f75 tempest-GroupSnapshotsTest-910622332 None] group_snapshot 2e955230-9875-4fd3-975f-00c6b1aa597f: deleted successfully Jul 09 15:16:27 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb" returned: 0 in 1.117s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:27 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 1073741824" returned: 0 in 1.239s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:27 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb Jul 09 15:16:27 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:27 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 Jul 09 15:16:27 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:28 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb" returned: 1 in 1.027s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Downloaded image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}])) to volume 12dc9a05-1191-47d9-8369-d6915e6aa2cb successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Temporary image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 for user 5ede6a10839b48b6a2940a8e644f9629 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Marking volume 12dc9a05-1191-47d9-8369-d6915e6aa2cb as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Copying metadata from image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 to 12dc9a05-1191-47d9-8369-d6915e6aa2cb. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Creating volume glance metadata for volume 12dc9a05-1191-47d9-8369-d6915e6aa2cb backed by image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:16:28 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781" returned: 0 in 1.008s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337472e9-fad9-41b9-b498-9b14113c30d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778f2366-0343-42ad-b0fb-9d2e7c106c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Volume volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 (b2ce8b5b-14c2-4090-80e2-9f0ce95ed781): created successfully Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778f2366-0343-42ad-b0fb-9d2e7c106c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Flow 'volume_create_manager' (0c362e0f-dfe8-468e-8d7f-2a2a4048b4b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-dbc41424-7c09-48ec-bccf-6762c326af1f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-646990a2-fd8d-4f45-bef0-7788ce8855c9 tempest-VolumeQuotasAdminTestJSON-1107955273 None] Created volume successfully. Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-dbc41424-7c09-48ec-bccf-6762c326af1f" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b4fe2f-4fca-487f-88b0-6c9f7f06d5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50768df7-23d0-4538-925f-1e329b178de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2950fe5b-912c-476b-b7fb-160327b573aa]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Volume volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb (12dc9a05-1191-47d9-8369-d6915e6aa2cb): created successfully Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50768df7-23d0-4538-925f-1e329b178de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Flow 'volume_create_manager' (42709927-9950-428f-9b1d-a30129c79a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-020009e9-1ead-474a-a3bf-4806b858e50c tempest-VolumesExtendTest-1520165656 None] Created volume successfully. Jul 09 15:16:28 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f Jul 09 15:16:28 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:29 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f" returned: 0 in 0.882s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:29 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f Jul 09 15:16:29 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-67a1a7ea-2dd5-4b3e-99cb-effbee8ea5a7 tempest-VolumeQuotasAdminTestJSON-201871945 None] Transfer volume completed successfully. Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4ff63b-d749-4f7f-8274-0b05425a5762]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:30 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dbc41424-7c09-48ec-bccf-6762c326af1f" returned: 0 in 0.746s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:30 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb Jul 09 15:16:30 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-dbc41424-7c09-48ec-bccf-6762c326af1f" released by "delete_volume" :: held 1.722s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['ce33ec3e-85f1-48d1-a617-f0704d49780a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:30 devstack cinder-volume[86916]: WARNING cinder.db.api [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-977052473'] Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['fb273fe5-e7d0-4060-a0df-017e67c70b00', '9f2a5ec4-585e-40ab-931f-1120b3d24c37', '5a6d4447-7240-4374-9e9e-d9eca88dcabb', '5a394a92-8925-4ceb-a56a-16bfce7a0237'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:30 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:16:30 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Acquiring lock "cinder-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Lock "cinder-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Acquiring lock "cinder-quobyte-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Lock "cinder-quobyte-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91a1862-32eb-4023-b03b-97e881fbe477]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:31 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb" returned: 0 in 1.201s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:31 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 Jul 09 15:16:31 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:31 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb Jul 09 15:16:31 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3e747832-a329-430f-be08-9e68cd9b47e3 tempest-GroupSnapshotsTest-910622332 None] Group tempest-GroupSnapshotsTest-Group-1390338513: creating Jul 09 15:16:31 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.300s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:31 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a745d6cd-9578-47e4-929a-9cfef1b0d620 tempest-GroupSnapshotsTest-910622332 None] Delete group completed successfully. Jul 09 15:16:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3e747832-a329-430f-be08-9e68cd9b47e3 tempest-GroupSnapshotsTest-910622332 None] Group tempest-GroupSnapshotsTest-Group-1390338513: created successfully Jul 09 15:16:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3e747832-a329-430f-be08-9e68cd9b47e3 tempest-GroupSnapshotsTest-910622332 None] Create group completed successfully. Jul 09 15:16:32 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781" returned: 0 in 0.981s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:32 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781 Jul 09 15:16:32 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:32 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Flow 'volume_create_manager' (72bdbed5-69e6-4fab-8904-08df86c39c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27be759-ee3f-4ed3-99c3-2f4405096e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb" returned: 1 in 1.195s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb 2G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27be759-ee3f-4ed3-99c3-2f4405096e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-106099760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342e4eb5-a6d9-4950-ace4-00f05410a1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6bc8751ee5f421a94c82a11a11f60a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:32Z,use_quota=True,user_id='a11e85deb70d419bb8ed9d7b3950df6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3c67c1-4a71-48b3-a299-a41c6066b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3c67c1-4a71-48b3-a299-a41c6066b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a29bbc5-a530-4321-bb50-650575363d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a29bbc5-a530-4321-bb50-650575363d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342e4eb5-a6d9-4950-ace4-00f05410a1d5', 'volume_name': 'volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcbdb9f-3b2e-4b12-8e45-b2901bec08be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcbdb9f-3b2e-4b12-8e45-b2901bec08be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b403d85-de31-4f12-961f-8e86f8118a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Volume 342e4eb5-a6d9-4950-ace4-00f05410a1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5', 'volume_size': 1} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb 2G" returned: 0 in 0.069s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.526s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-106099760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342e4eb5-a6d9-4950-ace4-00f05410a1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6bc8751ee5f421a94c82a11a11f60a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:32Z,use_quota=True,user_id='a11e85deb70d419bb8ed9d7b3950df6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Creating volume 342e4eb5-a6d9-4950-ace4-00f05410a1d5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:32 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:16:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:32 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 1073741824 Jul 09 15:16:32 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-16cb8118-b38a-45ed-bc36-fc51c8502f4b tempest-VolumesExtendTest-1520165656 None] Extend volume completed successfully. Jul 09 15:16:33 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781" returned: 0 in 0.758s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Lock "cinder-quobyte-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781" released by "delete_volume" :: held 1.807s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Created reservations ['b4db59c5-f1c1-441d-b780-3e28bfd2bb54', '02ba0a38-39ee-4863-8526-c5e708d1e1a4', '85521dac-8074-4bf6-a232-8fec3393d2c6', 'be520fa4-bb97-47ac-9157-6b2f0f4bb863'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:33 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:16:33 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Flow 'volume_create_manager' (e02c8c41-5554-4544-8e9a-79d17a9d36ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc349239-c167-450f-b3a2-0a16783151c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc349239-c167-450f-b3a2-0a16783151c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-753264733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18dbd0cd-8c62-41db-aecb-6dd3fbdb731a,host='devstack@QuobyteHD#QuobyteHD',id=88881095-df77-4dc8-9770-b028f7b030c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0150f1018dd6423a850d18dd12e4a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:33Z,use_quota=True,user_id='a9f578b18bae40a0b683232981ec4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd8aaeac-d0a6-4f43-a7be-d38ea4538054),volume_type_id=dd8aaeac-d0a6-4f43-a7be-d38ea4538054)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea31cbd-8ee4-465e-94bd-ca6f046b15ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea31cbd-8ee4-465e-94bd-ca6f046b15ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc885e4-152b-4ff6-a8a6-1e6a8635f255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc885e4-152b-4ff6-a8a6-1e6a8635f255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88881095-df77-4dc8-9770-b028f7b030c6', 'volume_name': 'volume-88881095-df77-4dc8-9770-b028f7b030c6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2e06ca-ca69-4849-8de6-ff1def6cbb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2e06ca-ca69-4849-8de6-ff1def6cbb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a852f0-a299-4d3e-b1b6-f0a6f384099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Volume 88881095-df77-4dc8-9770-b028f7b030c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88881095-df77-4dc8-9770-b028f7b030c6', 'volume_size': 1} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:33 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 1073741824" returned: 0 in 1.087s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:33 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 Jul 09 15:16:33 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Acquiring lock "cinder-12dc9a05-1191-47d9-8369-d6915e6aa2cb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Lock "cinder-12dc9a05-1191-47d9-8369-d6915e6aa2cb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Acquiring lock "cinder-quobyte-12dc9a05-1191-47d9-8369-d6915e6aa2cb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Lock "cinder-quobyte-12dc9a05-1191-47d9-8369-d6915e6aa2cb" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:34 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.895s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Deleted volume successfully. Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b4011737-264a-4869-a24f-e4228fbb51d0 tempest-VolumeQuotasAdminTestJSON-2126973651 None] Lock "cinder-b2ce8b5b-14c2-4090-80e2-9f0ce95ed781-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cafee3-2229-4a2d-bb01-4c4268fcc99b]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:34 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb Jul 09 15:16:34 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:34 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5" returned: 0 in 0.793s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=18dbd0cd-8c62-41db-aecb-6dd3fbdb731a,created_at=2026-07-09T13:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-753264733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18dbd0cd-8c62-41db-aecb-6dd3fbdb731a,host='devstack@QuobyteHD#QuobyteHD',id=88881095-df77-4dc8-9770-b028f7b030c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0150f1018dd6423a850d18dd12e4a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:33Z,use_quota=True,user_id='a9f578b18bae40a0b683232981ec4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd8aaeac-d0a6-4f43-a7be-d38ea4538054),volume_type_id=dd8aaeac-d0a6-4f43-a7be-d38ea4538054)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Creating volume 88881095-df77-4dc8-9770-b028f7b030c6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:34 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b403d85-de31-4f12-961f-8e86f8118a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:34 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 1073741824 Jul 09 15:16:34 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e8dbf3-0c4e-461b-8a03-f686f1f77a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Volume volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 (342e4eb5-a6d9-4950-ace4-00f05410a1d5): created successfully Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e8dbf3-0c4e-461b-8a03-f686f1f77a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Flow 'volume_create_manager' (72bdbed5-69e6-4fab-8904-08df86c39c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-25572a03-8b79-4ee6-980e-76a7ebabadb6 tempest-VolumesActionsTest-1733728859 None] Created volume successfully. Jul 09 15:16:35 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb" returned: 0 in 1.007s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:35 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb Jul 09 15:16:35 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:35 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 1073741824" returned: 0 in 1.129s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:35 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 Jul 09 15:16:35 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:36 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb" returned: 1 in 1.151s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:16:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:36 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb Jul 09 15:16:36 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:36 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6" returned: 0 in 0.941s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a852f0-a299-4d3e-b1b6-f0a6f384099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88881095-df77-4dc8-9770-b028f7b030c6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedbccf3-c7fd-4bf4-852e-29546a84531b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Volume volume-88881095-df77-4dc8-9770-b028f7b030c6 (88881095-df77-4dc8-9770-b028f7b030c6): created successfully Jul 09 15:16:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedbccf3-c7fd-4bf4-852e-29546a84531b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Flow 'volume_create_manager' (e02c8c41-5554-4544-8e9a-79d17a9d36ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-69c93704-f255-4b06-b7be-c022256ee2c3 tempest-GroupSnapshotsTest-910622332 None] Created volume successfully. Jul 09 15:16:37 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-12dc9a05-1191-47d9-8369-d6915e6aa2cb" returned: 0 in 0.735s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Lock "cinder-quobyte-12dc9a05-1191-47d9-8369-d6915e6aa2cb" released by "delete_volume" :: held 2.995s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Created reservations ['d9ac9189-abf0-453b-872f-1c11771e65bb', '0d436b40-3055-4df7-a3f7-631854334145', '8b563e5a-0f06-4338-b947-675802734843', '144f5855-04c2-46b0-b14c-810d58de3d42'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:37 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:16:37 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:38 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.005s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Deleted volume successfully. Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Flow 'volume_create_manager' (e7f43935-6644-4e3b-8faf-58ecb6c69285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05f41af-b638-4e9c-9e63-2ab3bae63e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05f41af-b638-4e9c-9e63-2ab3bae63e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-749493343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc3726e-7cfe-4749-ada2-4e66c73189d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d254c086d04ffca8784e2c4aab4d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:38Z,use_quota=True,user_id='5ede6a10839b48b6a2940a8e644f9629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a65627-dfc4-4f4f-9349-f765b223956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a65627-dfc4-4f4f-9349-f765b223956d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055f021c-6f9b-4fa3-a53e-01656016dbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055f021c-6f9b-4fa3-a53e-01656016dbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc3726e-7cfe-4749-ada2-4e66c73189d3', 'volume_name': 'volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ba6283-c53b-4bbe-bba0-0172b454ad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ba6283-c53b-4bbe-bba0-0172b454ad8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73da06fc-4d6c-4709-846b-b645df9127e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Volume ecc3726e-7cfe-4749-ada2-4e66c73189d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3', 'volume_size': 1} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-749493343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc3726e-7cfe-4749-ada2-4e66c73189d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d254c086d04ffca8784e2c4aab4d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:38Z,use_quota=True,user_id='5ede6a10839b48b6a2940a8e644f9629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Creating volume ecc3726e-7cfe-4749-ada2-4e66c73189d3 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:38 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6e14580c-40e5-416c-a922-de3f30a7509a tempest-VolumesExtendTest-1520165656 None] Lock "cinder-12dc9a05-1191-47d9-8369-d6915e6aa2cb-delete_volume" released by "delete_volume" :: held 4.539s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:38 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 1073741824 Jul 09 15:16:38 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Flow 'volume_create_manager' (e1f846b3-bfdd-4a8a-8405-2dd7ae106312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3ebcec-88ba-41c9-a0cf-61998bf81944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3ebcec-88ba-41c9-a0cf-61998bf81944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1778969926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18dbd0cd-8c62-41db-aecb-6dd3fbdb731a,host='devstack@QuobyteHD#QuobyteHD',id=4c39abe1-3a86-4dc9-8ac4-0f73624703c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0150f1018dd6423a850d18dd12e4a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:38Z,use_quota=True,user_id='a9f578b18bae40a0b683232981ec4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd8aaeac-d0a6-4f43-a7be-d38ea4538054),volume_type_id=dd8aaeac-d0a6-4f43-a7be-d38ea4538054)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff4f759-636c-47c7-85da-2206a537999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff4f759-636c-47c7-85da-2206a537999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d716f6ee-aabf-4f0a-9c6d-bb0f0ece2d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d716f6ee-aabf-4f0a-9c6d-bb0f0ece2d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c39abe1-3a86-4dc9-8ac4-0f73624703c1', 'volume_name': 'volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada7e726-0230-459c-bc59-b5819052c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada7e726-0230-459c-bc59-b5819052c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afeafb1c-c432-4f54-9316-a8a9ccdfd18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Volume 4c39abe1-3a86-4dc9-8ac4-0f73624703c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1', 'volume_size': 1} Jul 09 15:16:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:39 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 1073741824" returned: 0 in 0.893s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:39 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 Jul 09 15:16:39 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:40 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3" returned: 0 in 0.701s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=18dbd0cd-8c62-41db-aecb-6dd3fbdb731a,created_at=2026-07-09T13:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1778969926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18dbd0cd-8c62-41db-aecb-6dd3fbdb731a,host='devstack@QuobyteHD#QuobyteHD',id=4c39abe1-3a86-4dc9-8ac4-0f73624703c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0150f1018dd6423a850d18dd12e4a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:38Z,use_quota=True,user_id='a9f578b18bae40a0b683232981ec4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd8aaeac-d0a6-4f43-a7be-d38ea4538054),volume_type_id=dd8aaeac-d0a6-4f43-a7be-d38ea4538054)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Creating volume 4c39abe1-3a86-4dc9-8ac4-0f73624703c1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:40 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 1073741824 Jul 09 15:16:40 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73da06fc-4d6c-4709-846b-b645df9127e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a2b661-9edc-4e2a-b0a8-cbc935e02c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Volume volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 (ecc3726e-7cfe-4749-ada2-4e66c73189d3): created successfully Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a2b661-9edc-4e2a-b0a8-cbc935e02c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Flow 'volume_create_manager' (e7f43935-6644-4e3b-8faf-58ecb6c69285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5af5bce2-e7c4-4546-899d-6002185d1cf1 tempest-VolumesExtendTest-1520165656 None] Created volume successfully. Jul 09 15:16:41 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 1073741824" returned: 0 in 0.952s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:41 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 Jul 09 15:16:41 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:41 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" returned: 0 in 0.814s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.373s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Creating offline snapshot 7189813d-99a0-449f-8f15-97d9b5ad09d7 of volume ecc3726e-7cfe-4749-ada2-4e66c73189d3 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:16:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afeafb1c-c432-4f54-9316-a8a9ccdfd18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a3649b-7bb8-4da1-8aa3-3616c09e7701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6735f60-8df1-44bd-a6bd-c2fc0ba2c92b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Volume volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 (4c39abe1-3a86-4dc9-8ac4-0f73624703c1): created successfully Jul 09 15:16:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a3649b-7bb8-4da1-8aa3-3616c09e7701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Flow 'volume_create_manager' (e1f846b3-bfdd-4a8a-8405-2dd7ae106312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-85b46d5e-059a-43ed-b312-6bcbbc6832c0 tempest-GroupSnapshotsTest-910622332 None] Created volume successfully. Jul 09 15:16:42 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 Jul 09 15:16:42 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:43 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3" returned: 0 in 0.954s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:43 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 1G Jul 09 15:16:43 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f439618d-1f01-46c0-a5ed-12a31e94ae79 tempest-GroupSnapshotsTest-910622332 None] Update group completed successfully. Jul 09 15:16:44 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 1G" returned: 0 in 1.138s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:44 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 Jul 09 15:16:44 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:44 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=120,cinder:INSERT=39,cinder:UPDATE=148,cinder:DELETE=11 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:16:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f4ffc47d-767e-4bd2-a7ea-c32b53e3cf5c tempest-GroupSnapshotsTest-910622332 None] Update group completed successfully. Jul 09 15:16:44 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7" returned: 0 in 0.795s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:44 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 is being set with open permissions: ugo+rw Jul 09 15:16:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:44 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 Jul 09 15:16:44 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-838e38f4-b2c9-4fb5-bbad-3e53127c7fd4 tempest-GroupSnapshotsTest-910622332 None] Update group completed successfully. Jul 09 15:16:45 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7" returned: 0 in 0.706s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:45 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.info Jul 09 15:16:45 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:46 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.info" returned: 0 in 0.728s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:46 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.info is being set with open permissions: ugo+rw Jul 09 15:16:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:46 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.info Jul 09 15:16:46 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-82193132-2857-4a70-a666-2ca55ca7474d tempest-GroupSnapshotsTest-910622332 None] Update group completed successfully. Jul 09 15:16:47 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.info" returned: 0 in 0.661s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.122s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a923a2f7-76c1-4ac8-b7d7-799f175c1ff3 tempest-VolumesExtendTest-1520165656 None] Create snapshot completed successfully Jul 09 15:16:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:16:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:47 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:16:47 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f26a94b-2574-4554-8921-365ed971b9b9 tempest-VolumesExtendTest-1520165656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f26a94b-2574-4554-8921-365ed971b9b9 tempest-VolumesExtendTest-1520165656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4bfb6d-eeed-4c36-bbdd-0f8593cddc86]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f26a94b-2574-4554-8921-365ed971b9b9 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:48 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 Jul 09 15:16:48 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] GroupSnapshot f65ee4f7-cb7d-491c-a65c-fb8639ff976c: creating. Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Flow 'volume_create_manager' (33e4057a-d2bd-4fe8-bc8c-65bc3ceff7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be5081f-6436-4115-8dba-44472067e64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:48 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.087s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Group snapshot f65ee4f7-cb7d-491c-a65c-fb8639ff976c: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be5081f-6436-4115-8dba-44472067e64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1949125468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd42ca8-0291-40a1-87cf-8da7bf479d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b21bb01d904bb8a07e7a5e3a590f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:49Z,use_quota=True,user_id='f4007df2cd4b4c67a8f43a1716b8d80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98e10774-b8d5-4543-be4a-4fd6fd13ad46),volume_type_id=98e10774-b8d5-4543-be4a-4fd6fd13ad46)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a36b4a-603f-424b-aa69-15f1365f8811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a36b4a-603f-424b-aa69-15f1365f8811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38aafade-b108-4ab4-b97b-69c12132b421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38aafade-b108-4ab4-b97b-69c12132b421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd42ca8-0291-40a1-87cf-8da7bf479d46', 'volume_name': 'volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c913c5d5-c5de-4fcf-aad5-8fa13bbe4466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c913c5d5-c5de-4fcf-aad5-8fa13bbe4466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c69b37-2cfc-4a7b-8bc7-a37c1830a797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Volume ebd42ca8-0291-40a1-87cf-8da7bf479d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46', 'volume_size': 1} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:49 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f26a94b-2574-4554-8921-365ed971b9b9 tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3" returned: 0 in 0.845s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f26a94b-2574-4554-8921-365ed971b9b9 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 2G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f26a94b-2574-4554-8921-365ed971b9b9 tempest-VolumesExtendTest-1520165656 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 2G" returned: 0 in 0.170s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f26a94b-2574-4554-8921-365ed971b9b9 tempest-VolumesExtendTest-1520165656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.067s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.604s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1949125468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd42ca8-0291-40a1-87cf-8da7bf479d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b21bb01d904bb8a07e7a5e3a590f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:16:49Z,use_quota=True,user_id='f4007df2cd4b4c67a8f43a1716b8d80c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98e10774-b8d5-4543-be4a-4fd6fd13ad46),volume_type_id=98e10774-b8d5-4543-be4a-4fd6fd13ad46)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Creating volume ebd42ca8-0291-40a1-87cf-8da7bf479d46 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:16:49 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:16:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:49 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46 1073741824 Jul 09 15:16:49 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3f26a94b-2574-4554-8921-365ed971b9b9 tempest-VolumesExtendTest-1520165656 None] Extend volume completed successfully. Jul 09 15:16:50 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46 1073741824" returned: 0 in 0.889s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:50 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46 Jul 09 15:16:50 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Acquiring lock "cinder-7189813d-99a0-449f-8f15-97d9b5ad09d7-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Lock "cinder-7189813d-99a0-449f-8f15-97d9b5ad09d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Acquiring lock "cinder-quobyte-ecc3726e-7cfe-4749-ada2-4e66c73189d3" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Lock "cinder-quobyte-ecc3726e-7cfe-4749-ada2-4e66c73189d3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Acquiring lock "cinder-quobyte-7189813d-99a0-449f-8f15-97d9b5ad09d7" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Lock "cinder-quobyte-7189813d-99a0-449f-8f15-97d9b5ad09d7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Deleting offline snapshot 7189813d-99a0-449f-8f15-97d9b5ad09d7 of volume ecc3726e-7cfe-4749-ada2-4e66c73189d3 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:16:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] snapshot_file for this snap is: volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c1a697-629a-4b51-91c5-3460222d3ba1]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:51 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 Jul 09 15:16:51 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:51 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46" returned: 0 in 0.741s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.279s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Creating offline snapshot 30548908-e28d-415e-8163-cbdbb6308406 of volume 4c39abe1-3a86-4dc9-8ac4-0f73624703c1 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c69b37-2cfc-4a7b-8bc7-a37c1830a797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a44675f-5266-48e4-bb49-72ef09d3ef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[876f1b74-5cd5-49c5-aca2-f5d90a47c9d8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=149,cinder:SELECT=134,cinder:INSERT=37,cinder:DELETE=7 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:16:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Volume volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46 (ebd42ca8-0291-40a1-87cf-8da7bf479d46): created successfully Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a44675f-5266-48e4-bb49-72ef09d3ef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Flow 'volume_create_manager' (33e4057a-d2bd-4fe8-bc8c-65bc3ceff7e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:16:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0c7dc72c-dc05-4ba6-b15a-dc6cbea2b187 tempest-VolumeTypesAccessTest-2015237584 None] Created volume successfully. Jul 09 15:16:51 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 Jul 09 15:16:51 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0919ae07-2469-414a-8e07-d15b29619567 tempest-VolumesActionsTest-1733728859 None] Acquiring lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5" by "attach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0919ae07-2469-414a-8e07-d15b29619567 tempest-VolumesActionsTest-1733728859 None] Lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5" acquired by "attach_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0919ae07-2469-414a-8e07-d15b29619567 tempest-VolumesActionsTest-1733728859 None] Attaching volume 342e4eb5-a6d9-4950-ace4-00f05410a1d5 to instance c5519ab0-db12-4c4a-b68c-c0d0cce0ff04 at mountpoint /dev/vdb on host None. Jul 09 15:16:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0919ae07-2469-414a-8e07-d15b29619567 tempest-VolumesActionsTest-1733728859 None] Attach volume completed successfully. Jul 09 15:16:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0919ae07-2469-414a-8e07-d15b29619567 tempest-VolumesActionsTest-1733728859 None] Lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5" released by "attach_volume" :: held 0.184s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:52 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7" returned: 0 in 1.061s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Acquiring lock "cinder-ebd42ca8-0291-40a1-87cf-8da7bf479d46-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b457647d-3a80-42b2-8473-bd1870ce666f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Lock "cinder-ebd42ca8-0291-40a1-87cf-8da7bf479d46-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Acquiring lock "cinder-quobyte-ebd42ca8-0291-40a1-87cf-8da7bf479d46" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Lock "cinder-quobyte-ebd42ca8-0291-40a1-87cf-8da7bf479d46" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e50f5ed-1e56-44b6-9d0c-a72ca12f749a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:52 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 Jul 09 15:16:52 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-930b0904-9e01-4dda-9af2-3e2faa0ed362 tempest-VolumesActionsTest-1733728859 None] Acquiring lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-930b0904-9e01-4dda-9af2-3e2faa0ed362 tempest-VolumesActionsTest-1733728859 None] Lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-930b0904-9e01-4dda-9af2-3e2faa0ed362 tempest-VolumesActionsTest-1733728859 None] Detaching volume 342e4eb5-a6d9-4950-ace4-00f05410a1d5 from instance c5519ab0-db12-4c4a-b68c-c0d0cce0ff04. Jul 09 15:16:52 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-930b0904-9e01-4dda-9af2-3e2faa0ed362 tempest-VolumesActionsTest-1733728859 None] Detach volume completed successfully. Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" returned: 0 in 1.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:52 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46 Jul 09 15:16:52 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-930b0904-9e01-4dda-9af2-3e2faa0ed362 tempest-VolumesActionsTest-1733728859 None] Lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:52 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 1G Jul 09 15:16:52 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:53 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46" returned: 0 in 1.035s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:53 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46 Jul 09 15:16:53 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:53 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3" returned: 0 in 1.360s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:53 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 Jul 09 15:16:53 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:53 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 1G" returned: 0 in 1.084s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:53 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 Jul 09 15:16:53 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:54 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebd42ca8-0291-40a1-87cf-8da7bf479d46" returned: 0 in 0.923s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Lock "cinder-quobyte-ebd42ca8-0291-40a1-87cf-8da7bf479d46" released by "delete_volume" :: held 2.040s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:54 devstack cinder-volume[86916]: WARNING cinder.quota [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-479329508 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-479329508, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:16:54 devstack cinder-volume[86916]: WARNING cinder.quota [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-479329508 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-479329508, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:16:54 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Created reservations ['3af091dd-2a9c-47dc-b070-54c6f05d88f3', 'a0abf852-e8bc-47aa-9d5b-c61c0d8eb0f6', '7846793a-cc7b-4313-8b86-e09a1e1ac759', 'c40f94d6-3876-42d8-9e34-01ba5059a7a7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7" returned: 0 in 0.951s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:54 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7 Jul 09 15:16:54 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:54 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:16:54 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:54 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406" returned: 0 in 0.980s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:54 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:16:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:54 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 Jul 09 15:16:54 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:55 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3.7189813d-99a0-449f-8f15-97d9b5ad09d7" returned: 0 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Lock "cinder-quobyte-7189813d-99a0-449f-8f15-97d9b5ad09d7" released by "_delete_snapshot" :: held 4.172s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Lock "cinder-quobyte-ecc3726e-7cfe-4749-ada2-4e66c73189d3" released by "delete_snapshot" :: held 4.219s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Created reservations ['445218b2-59ec-47d3-8960-46c05c5f4a87', 'd851c394-d9d2-4961-b35c-ca9aebbaff7f', 'c7184547-a50b-4746-bcd0-6dc5c3cdef00', '696225fc-0a87-4aa5-9303-0d316f398122'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:55 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:55 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.898s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:55 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406" returned: 0 in 0.858s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Deleted volume successfully. Jul 09 15:16:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Delete snapshot completed successfully. Jul 09 15:16:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d31c7ee1-7292-48af-9fcb-2c665ef2d9d9 tempest-VolumesExtendTest-1520165656 None] Lock "cinder-7189813d-99a0-449f-8f15-97d9b5ad09d7-delete_snapshot" released by "delete_snapshot" :: held 4.526s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-461ce54c-e354-4a61-96f6-f463f872c750 tempest-VolumeTypesAccessTest-2015237584 None] Lock "cinder-ebd42ca8-0291-40a1-87cf-8da7bf479d46-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:55 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.info Jul 09 15:16:55 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:56 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.info" returned: 0 in 0.730s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:56 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:16:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:56 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.info Jul 09 15:16:56 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Acquiring lock "cinder-ecc3726e-7cfe-4749-ada2-4e66c73189d3-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Lock "cinder-ecc3726e-7cfe-4749-ada2-4e66c73189d3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Acquiring lock "cinder-quobyte-ecc3726e-7cfe-4749-ada2-4e66c73189d3" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:16:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Lock "cinder-quobyte-ecc3726e-7cfe-4749-ada2-4e66c73189d3" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:16:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeed13c-42da-4db0-a074-25269a2d797c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:56 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 Jul 09 15:16:56 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:57 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.info" returned: 0 in 0.874s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.905s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Creating offline snapshot 37c8432a-73f7-40c3-b8b9-13eca8dabeb2 of volume 88881095-df77-4dc8-9770-b028f7b030c6 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:16:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca39d42b-ce7f-4a07-b42b-286f1e35546a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:16:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:57 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 Jul 09 15:16:57 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:57 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3" returned: 0 in 0.858s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:57 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3 Jul 09 15:16:57 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:58 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6" returned: 0 in 0.953s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:58 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 1G Jul 09 15:16:58 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:58 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ecc3726e-7cfe-4749-ada2-4e66c73189d3" returned: 0 in 0.795s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Lock "cinder-quobyte-ecc3726e-7cfe-4749-ada2-4e66c73189d3" released by "delete_volume" :: held 1.740s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Created reservations ['4e8b2763-7657-47eb-ae78-a707f9ae1fa2', 'a47fb42e-8e23-4caa-a680-b76400385e11', 'fd39c47e-53be-49da-aebc-3503fdf3fd3b', 'b87a7153-8269-4991-a384-b4f98dca2847'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:16:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:58 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:16:58 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:59 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 1G" returned: 0 in 1.193s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88881095-df77-4dc8-9770-b028f7b030c6 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:16:59 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88881095-df77-4dc8-9770-b028f7b030c6 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 Jul 09 15:16:59 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:16:59 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 09 15:16:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.930s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:16:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:16:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Deleted volume successfully. Jul 09 15:16:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-94b06dc8-fad5-4096-bb1d-513d0dc4336d tempest-VolumesExtendTest-1520165656 None] Lock "cinder-ecc3726e-7cfe-4749-ada2-4e66c73189d3-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:00 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88881095-df77-4dc8-9770-b028f7b030c6 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2" returned: 0 in 0.923s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:00 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:17:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:00 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 Jul 09 15:17:00 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:01 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2" returned: 0 in 0.804s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:01 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.info Jul 09 15:17:01 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:01 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.info" returned: 0 in 0.732s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:01 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:17:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:01 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.info Jul 09 15:17:01 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:02 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.info" returned: 0 in 0.677s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.398s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-58382739-a0e8-434f-beed-f81d1e66948d tempest-GroupSnapshotsTest-910622332 None] group_snapshot f65ee4f7-cb7d-491c-a65c-fb8639ff976c: created successfully Jul 09 15:17:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Flow 'volume_create_manager' (27b0d6ab-2b39-4f7e-9c5a-f0a8e461d767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab22e04f-4f8f-400c-81d5-3830afa73501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab22e04f-4f8f-400c-81d5-3830afa73501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1242874798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ed8d86-4a78-4248-9ea1-c6093eca9c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab33731794394aa5be76987867764a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:03Z,use_quota=True,user_id='7a64eac43c714a55aab6b2f56df245ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa225a0f-56df-4fad-86ca-eb44f96dd9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa225a0f-56df-4fad-86ca-eb44f96dd9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf35aa5-62b3-4dab-8b67-306bb18057e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf35aa5-62b3-4dab-8b67-306bb18057e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ed8d86-4a78-4248-9ea1-c6093eca9c25', 'volume_name': 'volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739957f0-90cf-4736-b3b2-35f9ba5b9b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739957f0-90cf-4736-b3b2-35f9ba5b9b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc47da2-d132-4dc9-a0fc-65a70c679ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Volume b3ed8d86-4a78-4248-9ea1-c6093eca9c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25', 'volume_size': 1} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1242874798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ed8d86-4a78-4248-9ea1-c6093eca9c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab33731794394aa5be76987867764a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:03Z,use_quota=True,user_id='7a64eac43c714a55aab6b2f56df245ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Creating volume b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:17:03 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:03 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 1073741824 Jul 09 15:17:03 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] group_snapshot f65ee4f7-cb7d-491c-a65c-fb8639ff976c: deleting Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] group_snapshot f65ee4f7-cb7d-491c-a65c-fb8639ff976c: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-30548908-e28d-415e-8163-cbdbb6308406" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-30548908-e28d-415e-8163-cbdbb6308406" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Deleting offline snapshot 30548908-e28d-415e-8163-cbdbb6308406 of volume 4c39abe1-3a86-4dc9-8ac4-0f73624703c1 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:17:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] snapshot_file for this snap is: volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:17:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f8dd17-cf1c-4c2c-aa88-4a161c3deac4]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:04 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 Jul 09 15:17:04 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:04 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 1073741824" returned: 0 in 1.130s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:04 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 Jul 09 15:17:04 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:04 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406" returned: 0 in 0.940s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[03408e4f-3461-472b-85ce-a8b2163d2517]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:05 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" returned: 0 in 0.773s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc47da2-d132-4dc9-a0fc-65a70c679ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed90d60-baad-4f5e-860d-458f46c0b352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Volume volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 (b3ed8d86-4a78-4248-9ea1-c6093eca9c25): created successfully Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed90d60-baad-4f5e-860d-458f46c0b352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Flow 'volume_create_manager' (27b0d6ab-2b39-4f7e-9c5a-f0a8e461d767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-515a630e-1980-41aa-a4ba-8c0d0b7a1a3d tempest-VolumesSnapshotListTestJSON-839262604 None] Created volume successfully. Jul 09 15:17:05 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 Jul 09 15:17:05 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:05 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" returned: 0 in 0.841s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:05 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 Jul 09 15:17:05 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Creating offline snapshot 6b01a419-20d1-44a6-8c7a-f6261f69612c of volume b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:17:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[792509e9-b5a4-4a38-8f9d-85352ec32935]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:06 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 Jul 09 15:17:06 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:06 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406" returned: 0 in 0.930s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:06 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406 Jul 09 15:17:06 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:07 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" returned: 0 in 0.890s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:07 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c 1G Jul 09 15:17:07 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:07 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1.30548908-e28d-415e-8163-cbdbb6308406" returned: 0 in 0.730s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-30548908-e28d-415e-8163-cbdbb6308406" released by "_delete_snapshot" :: held 3.583s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" released by "delete_snapshot" :: held 3.622s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-88881095-df77-4dc8-9770-b028f7b030c6" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-88881095-df77-4dc8-9770-b028f7b030c6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-37c8432a-73f7-40c3-b8b9-13eca8dabeb2" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-37c8432a-73f7-40c3-b8b9-13eca8dabeb2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Deleting offline snapshot 37c8432a-73f7-40c3-b8b9-13eca8dabeb2 of volume 88881095-df77-4dc8-9770-b028f7b030c6 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] snapshot_file for this snap is: volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f28e611-70be-4dd8-8ff3-aa00ac12d394]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:07 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 Jul 09 15:17:07 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:08 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c 1G" returned: 0 in 0.993s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:08 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c Jul 09 15:17:08 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:08 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2" returned: 0 in 0.959s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88881095-df77-4dc8-9770-b028f7b030c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:17:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5c5301-9c82-4986-955b-6152271a131d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:08 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 Jul 09 15:17:08 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:09 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c" returned: 0 in 0.999s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:09 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c is being set with open permissions: ugo+rw Jul 09 15:17:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:09 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c Jul 09 15:17:09 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:09 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6" returned: 0 in 1.223s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:09 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 Jul 09 15:17:09 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:10 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c" returned: 0 in 0.954s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:10 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.info Jul 09 15:17:10 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:11 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2" returned: 0 in 1.211s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:11 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2 Jul 09 15:17:11 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:11 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.info" returned: 0 in 0.999s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:11 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.info is being set with open permissions: ugo+rw Jul 09 15:17:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:11 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.info Jul 09 15:17:11 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:11 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6.37c8432a-73f7-40c3-b8b9-13eca8dabeb2" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-37c8432a-73f7-40c3-b8b9-13eca8dabeb2" released by "_delete_snapshot" :: held 4.281s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-88881095-df77-4dc8-9770-b028f7b030c6" released by "delete_snapshot" :: held 4.302s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:11 devstack cinder-volume[86916]: WARNING cinder.quota [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1593196744 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1593196744, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:17:11 devstack cinder-volume[86916]: WARNING cinder.quota [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1593196744 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1593196744, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:17:12 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['37fe137a-35d5-495f-b082-e3fd5bad0c16', '40f6f4f7-206e-41d7-919b-3f6bb3424654', 'fe99d7c4-2f5b-4ea6-ac83-fc599a5bb8b1', '29508c49-cc91-403f-8582-242017768b9e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:12 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.info" returned: 0 in 0.730s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.694s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:12 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['ed2a6527-ead7-45f4-b95d-db931aa1c2dc', 'df4571c8-55b2-4408-a622-1876b0328a36', '43ebc238-6fd8-434e-b975-2b9333b70aa7', '01635949-40dc-4e29-b638-0d8df2a98f36'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-de7b4ab4-3261-40ae-b034-968cbca66f95 tempest-VolumesSnapshotListTestJSON-839262604 None] Create snapshot completed successfully Jul 09 15:17:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c879ac49-ebdb-437e-908d-4c9f2d0e2c29 tempest-GroupSnapshotsTest-910622332 None] group_snapshot f65ee4f7-cb7d-491c-a65c-fb8639ff976c: deleted successfully Jul 09 15:17:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] Creating offline snapshot d226706e-7a04-4f09-860e-abfb00597333 of volume b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:17:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd47927b-382b-4f2a-bd01-5a72b3d178e5]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fe4ba4-b81a-4ea2-b9bc-d9f4c5de5ae5]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:13 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c Jul 09 15:17:13 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:13 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 Jul 09 15:17:13 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:14 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:14 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c" returned: 0 in 0.927s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:17:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" returned: 0 in 0.864s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:14 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 1G Jul 09 15:17:14 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:14 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1 Jul 09 15:17:14 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:15 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" returned: 0 in 1.123s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-4c39abe1-3a86-4dc9-8ac4-0f73624703c1" released by "delete_volume" :: held 2.084s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-88881095-df77-4dc8-9770-b028f7b030c6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-88881095-df77-4dc8-9770-b028f7b030c6" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a00a0bd-cca7-4fd9-a98b-8be66fb4e0a2]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:15 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 Jul 09 15:17:15 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:15 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 1G" returned: 0 in 1.510s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:15 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 Jul 09 15:17:15 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:16 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333" returned: 0 in 0.840s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:16 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 is being set with open permissions: ugo+rw Jul 09 15:17:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:16 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 Jul 09 15:17:16 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:16 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6" returned: 0 in 1.202s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:16 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6 Jul 09 15:17:16 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:17 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333" returned: 0 in 0.995s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.414s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:17 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-88881095-df77-4dc8-9770-b028f7b030c6" returned: 0 in 0.965s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-88881095-df77-4dc8-9770-b028f7b030c6" released by "delete_volume" :: held 2.253s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6b21c5cc-ca78-4e3a-9f73-35efc33f1817 tempest-VolumesSnapshotListTestJSON-839262604 None] Create snapshot completed successfully Jul 09 15:17:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['6be627da-6a08-43fa-a2e1-345fe7569e71'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:17 devstack cinder-volume[86916]: WARNING cinder.quota [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1593196744 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1593196744, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:17:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['1642d767-0876-4c2c-8cdd-97aa2b35fcb3', '94ef88be-5156-4831-b235-971536561094', 'b9575c91-2e11-42c3-ada0-fe59b18e2cc8', 'a54e59eb-da1a-4a04-a769-3e8ac3f48674'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:17 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['df594ce9-6996-4ff4-aa00-99e03541df11', '68119050-942b-43d9-9e75-d380c21a29c4', '377b186a-2e65-43f1-aa6a-c309e15362a7', '4a1c98ff-46a6-4169-bb98-cdbd7981b947'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:18 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:17:18 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] Creating offline snapshot c1fb00bc-643a-4590-b459-cf777ef3448e of volume b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e047315-c3a9-496b-a1cd-82c47e1087c3]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7373f782-a103-482e-90af-49da87f80250 tempest-GroupSnapshotsTest-910622332 None] Group tempest-GroupSnapshotsTest-Group-543391340: creating Jul 09 15:17:19 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 Jul 09 15:17:19 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7373f782-a103-482e-90af-49da87f80250 tempest-GroupSnapshotsTest-910622332 None] Group tempest-GroupSnapshotsTest-Group-543391340: created successfully Jul 09 15:17:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7373f782-a103-482e-90af-49da87f80250 tempest-GroupSnapshotsTest-910622332 None] Create group completed successfully. Jul 09 15:17:19 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.355s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:19 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:17:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ab32209b-e071-4824-b8a4-994bb9be5ca7 tempest-GroupSnapshotsTest-910622332 None] Delete group completed successfully. Jul 09 15:17:20 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333" returned: 0 in 1.120s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:17:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:20 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e 1G Jul 09 15:17:20 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ccb3752d-b3a5-4f42-a632-ed8da3f25a25 tempest-VolumesActionsTest-1733728859 None] Acquiring lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5" by "attach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ccb3752d-b3a5-4f42-a632-ed8da3f25a25 tempest-VolumesActionsTest-1733728859 None] Lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5" acquired by "attach_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ccb3752d-b3a5-4f42-a632-ed8da3f25a25 tempest-VolumesActionsTest-1733728859 None] Attaching volume 342e4eb5-a6d9-4950-ace4-00f05410a1d5 to instance 2b5b4d76-1cb3-494f-89a9-684d3812437c at mountpoint /dev/vdb on host None. Jul 09 15:17:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ccb3752d-b3a5-4f42-a632-ed8da3f25a25 tempest-VolumesActionsTest-1733728859 None] Attach volume completed successfully. Jul 09 15:17:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ccb3752d-b3a5-4f42-a632-ed8da3f25a25 tempest-VolumesActionsTest-1733728859 None] Lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5" released by "attach_volume" :: held 0.114s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Flow 'volume_create_manager' (1fcae44c-6527-4135-bbae-ddd514bc344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ac1565-444c-4898-854a-da214681796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ac1565-444c-4898-854a-da214681796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1496108212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2bdb9b33-c4a2-46af-a370-76dd7036df2e,host='devstack@QuobyteHD#QuobyteHD',id=9df253cd-3763-4d58-bae7-225f3c1ee26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0150f1018dd6423a850d18dd12e4a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:21Z,use_quota=True,user_id='a9f578b18bae40a0b683232981ec4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(456218a1-d6b0-49b6-9fca-a4d12fd596e4),volume_type_id=456218a1-d6b0-49b6-9fca-a4d12fd596e4)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba242ef-bd9e-4ed8-b90b-a590d80d8224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba242ef-bd9e-4ed8-b90b-a590d80d8224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc792aaf-12ac-4d3f-872f-59462e04f64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc792aaf-12ac-4d3f-872f-59462e04f64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df253cd-3763-4d58-bae7-225f3c1ee26c', 'volume_name': 'volume-9df253cd-3763-4d58-bae7-225f3c1ee26c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b7237d-b2e6-4d14-9c1d-9ef90950a7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b7237d-b2e6-4d14-9c1d-9ef90950a7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0aee128-1ea7-4120-ac90-295496c0f629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Volume 9df253cd-3763-4d58-bae7-225f3c1ee26c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df253cd-3763-4d58-bae7-225f3c1ee26c', 'volume_size': 1} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-da8e3891-cf8a-45a4-8d00-30af69e5431f tempest-VolumesActionsTest-1733728859 None] Acquiring lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-da8e3891-cf8a-45a4-8d00-30af69e5431f tempest-VolumesActionsTest-1733728859 None] Lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-da8e3891-cf8a-45a4-8d00-30af69e5431f tempest-VolumesActionsTest-1733728859 None] Detaching volume 342e4eb5-a6d9-4950-ace4-00f05410a1d5 from instance 2b5b4d76-1cb3-494f-89a9-684d3812437c. Jul 09 15:17:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-da8e3891-cf8a-45a4-8d00-30af69e5431f tempest-VolumesActionsTest-1733728859 None] Detach volume completed successfully. Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-da8e3891-cf8a-45a4-8d00-30af69e5431f tempest-VolumesActionsTest-1733728859 None] Lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:21 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e 1G" returned: 0 in 1.503s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:21 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e Jul 09 15:17:21 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:22 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e" returned: 0 in 0.897s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:22 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e is being set with open permissions: ugo+rw Jul 09 15:17:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:22 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e Jul 09 15:17:22 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:23 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e" returned: 0 in 0.743s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.463s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2bdb9b33-c4a2-46af-a370-76dd7036df2e,created_at=2026-07-09T13:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1496108212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2bdb9b33-c4a2-46af-a370-76dd7036df2e,host='devstack@QuobyteHD#QuobyteHD',id=9df253cd-3763-4d58-bae7-225f3c1ee26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0150f1018dd6423a850d18dd12e4a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:21Z,use_quota=True,user_id='a9f578b18bae40a0b683232981ec4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(456218a1-d6b0-49b6-9fca-a4d12fd596e4),volume_type_id=456218a1-d6b0-49b6-9fca-a4d12fd596e4)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Creating volume 9df253cd-3763-4d58-bae7-225f3c1ee26c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:17:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:17:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:23 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c 1073741824 Jul 09 15:17:23 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a19027bd-10bd-42f9-91c1-a617b60cd35d tempest-VolumesSnapshotListTestJSON-839262604 None] Create snapshot completed successfully Jul 09 15:17:24 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c 1073741824" returned: 0 in 0.999s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:24 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c Jul 09 15:17:24 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:25 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c" returned: 0 in 0.960s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-c1fb00bc-643a-4590-b459-cf777ef3448e-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0aee128-1ea7-4120-ac90-295496c0f629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df253cd-3763-4d58-bae7-225f3c1ee26c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff0f16a-7b89-4b12-b9e5-8e6504a07ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-c1fb00bc-643a-4590-b459-cf777ef3448e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-quobyte-c1fb00bc-643a-4590-b459-cf777ef3448e" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Volume volume-9df253cd-3763-4d58-bae7-225f3c1ee26c (9df253cd-3763-4d58-bae7-225f3c1ee26c): created successfully Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff0f16a-7b89-4b12-b9e5-8e6504a07ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Flow 'volume_create_manager' (1fcae44c-6527-4135-bbae-ddd514bc344d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-c1fb00bc-643a-4590-b459-cf777ef3448e" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Deleting offline snapshot c1fb00bc-643a-4590-b459-cf777ef3448e of volume b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] snapshot_file for this snap is: volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:17:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a55ea535-6e46-4b72-9e56-33c94c43fd3b tempest-GroupSnapshotsTest-910622332 None] Created volume successfully. Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9054e4f-389c-4c68-902d-145e4c7d9c9c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:25 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e Jul 09 15:17:25 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] GroupSnapshot 4b8a49e0-7ff4-4c56-b732-c8b8747030e7: creating. Jul 09 15:17:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Group snapshot 4b8a49e0-7ff4-4c56-b732-c8b8747030e7: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 15:17:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:26 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Creating offline snapshot 88c779c0-5324-4f5f-9508-e7597a3c3ae2 of volume 9df253cd-3763-4d58-bae7-225f3c1ee26c {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:17:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e" returned: 0 in 0.808s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:17:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba262034-cf0f-4de7-810e-eaae4d2d7c85]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a72fab-590c-43fb-bed7-caae89c58684]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:26 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c Jul 09 15:17:26 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:26 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 Jul 09 15:17:26 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:27 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c" returned: 0 in 0.967s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:27 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 1G Jul 09 15:17:27 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:27 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333" returned: 0 in 0.995s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:17:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:27 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e Jul 09 15:17:27 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:28 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 1G" returned: 0 in 0.899s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df253cd-3763-4d58-bae7-225f3c1ee26c -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:28 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df253cd-3763-4d58-bae7-225f3c1ee26c -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 Jul 09 15:17:28 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:28 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e" returned: 0 in 0.945s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:28 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e Jul 09 15:17:28 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:28 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df253cd-3763-4d58-bae7-225f3c1ee26c -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2" returned: 0 in 0.785s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:28 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:17:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:28 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 Jul 09 15:17:28 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:29 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.c1fb00bc-643a-4590-b459-cf777ef3448e" returned: 0 in 0.777s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-c1fb00bc-643a-4590-b459-cf777ef3448e" released by "_delete_snapshot" :: held 3.658s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" released by "delete_snapshot" :: held 3.709s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Created reservations ['e5691cf6-8fd1-49d6-a7c9-f62c710af448', '04d65984-375d-4058-b9e7-1f3e238fb81a', 'bc79ef02-9acb-4719-a247-4192d437b359', 'cc5713ab-f01c-4e2d-b607-6f57754b4b82'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Delete snapshot completed successfully. Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e5f41221-b1d1-44fd-a39e-c63809f1c28f tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-c1fb00bc-643a-4590-b459-cf777ef3448e-delete_snapshot" released by "delete_snapshot" :: held 3.946s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-d226706e-7a04-4f09-860e-abfb00597333-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-d226706e-7a04-4f09-860e-abfb00597333-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-quobyte-d226706e-7a04-4f09-860e-abfb00597333" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-d226706e-7a04-4f09-860e-abfb00597333" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Deleting offline snapshot d226706e-7a04-4f09-860e-abfb00597333 of volume b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] snapshot_file for this snap is: volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[febf1bab-1f19-48e7-bee7-44c498c5d80b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:29 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2" returned: 0 in 0.903s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:29 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 Jul 09 15:17:29 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:29 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.info Jul 09 15:17:29 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:30 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333" returned: 0 in 0.863s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:17:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d16cf5-0ddb-4403-b0d9-be3d8a60e3f8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:30 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.info" returned: 0 in 0.831s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:30 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:17:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:30 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.info Jul 09 15:17:30 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:30 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c Jul 09 15:17:30 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:31 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.info" returned: 0 in 0.724s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.222s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.444s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe67171-4655-4ef7-b111-7bfc389f1564]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:31 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c" returned: 0 in 0.864s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:17:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:31 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 Jul 09 15:17:31 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8f80186e-1ef7-48fc-9657-f465c5203828 tempest-GroupSnapshotsTest-910622332 None] group_snapshot 4b8a49e0-7ff4-4c56-b732-c8b8747030e7: created successfully Jul 09 15:17:31 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 Jul 09 15:17:31 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:32 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5" returned: 0 in 0.810s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[07df6f0a-ba25-4189-b36e-ae8af318f104]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:32 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333" returned: 0 in 0.828s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:32 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333 Jul 09 15:17:32 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:32 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 Jul 09 15:17:32 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] group_snapshot 4b8a49e0-7ff4-4c56-b732-c8b8747030e7: deleting Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] group_snapshot 4b8a49e0-7ff4-4c56-b732-c8b8747030e7: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-9df253cd-3763-4d58-bae7-225f3c1ee26c" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-9df253cd-3763-4d58-bae7-225f3c1ee26c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-88c779c0-5324-4f5f-9508-e7597a3c3ae2" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-88c779c0-5324-4f5f-9508-e7597a3c3ae2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Deleting offline snapshot 88c779c0-5324-4f5f-9508-e7597a3c3ae2 of volume 9df253cd-3763-4d58-bae7-225f3c1ee26c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] snapshot_file for this snap is: volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[74964a1b-31b2-4b0a-8494-57ec00ee386e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:33 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.d226706e-7a04-4f09-860e-abfb00597333" returned: 0 in 0.901s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-d226706e-7a04-4f09-860e-abfb00597333" released by "_delete_snapshot" :: held 3.632s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" released by "delete_snapshot" :: held 3.666s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:33 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 Jul 09 15:17:33 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:33 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5" returned: 0 in 1.057s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.9b04ba2e-ba61-442b-be87-cf6f464117d9pdsiqc_j.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Created reservations ['978531c1-ba6c-4ba3-afa2-7fa9d819b1bd', '6242b784-ab8e-4cb1-917e-99c16af77561', '0a9abdfd-4ef1-4585-9eb0-e2492aaee1dd', 'c386b49d-5a01-4dbf-909b-c13f999e3fae'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:33 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.9b04ba2e-ba61-442b-be87-cf6f464117d9pdsiqc_j.img Jul 09 15:17:33 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Delete snapshot completed successfully. Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3ac56911-a1cb-428f-a4ce-e482818ef48d tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-d226706e-7a04-4f09-860e-abfb00597333-delete_snapshot" released by "delete_snapshot" :: held 3.855s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-6b01a419-20d1-44a6-8c7a-f6261f69612c-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-6b01a419-20d1-44a6-8c7a-f6261f69612c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-quobyte-6b01a419-20d1-44a6-8c7a-f6261f69612c" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-6b01a419-20d1-44a6-8c7a-f6261f69612c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Deleting offline snapshot 6b01a419-20d1-44a6-8c7a-f6261f69612c of volume b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:17:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] snapshot_file for this snap is: volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:17:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18035a7-fb01-4367-9451-1294ac0ef607]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:34 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2" returned: 0 in 0.983s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9df253cd-3763-4d58-bae7-225f3c1ee26c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:17:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24555fb-faff-471d-984c-aed46a9fa032]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:34 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c Jul 09 15:17:34 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:34 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c Jul 09 15:17:34 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:35 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c" returned: 0 in 1.370s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:17:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc17d75f-3d9e-451f-b095-506e5c0a4170]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:35 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 Jul 09 15:17:35 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:36 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c" returned: 0 in 2.563s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:36 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 Jul 09 15:17:36 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:38 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" returned: 0 in 2.506s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:38 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c Jul 09 15:17:38 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:38 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2" returned: 0 in 1.788s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:38 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2 Jul 09 15:17:38 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:39 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c" returned: 0 in 1.716s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:39 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c Jul 09 15:17:39 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:40 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c.88c779c0-5324-4f5f-9508-e7597a3c3ae2" returned: 0 in 1.564s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-88c779c0-5324-4f5f-9508-e7597a3c3ae2" released by "_delete_snapshot" :: held 7.058s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-9df253cd-3763-4d58-bae7-225f3c1ee26c" released by "delete_snapshot" :: held 7.098s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:40 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.9b04ba2e-ba61-442b-be87-cf6f464117d9pdsiqc_j.img" returned: 0 in 6.912s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8ea239-c810-4604-b28c-12409ee3fe6b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:40 devstack cinder-volume[86916]: WARNING cinder.quota [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-360501876 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-360501876, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:17:40 devstack cinder-volume[86916]: WARNING cinder.quota [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-360501876 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-360501876, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] Created reservations ['8abca774-8276-42e6-9667-7728c797756d', '7599300d-4814-427b-a2c3-86c051083a4a', 'f34e93dc-3f54-41e9-ae23-36199f2e57d5', '4a584bd5-3109-4e3f-a4c2-3996200a46dd'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6957e271-3411-446a-8094-ef30d9a70ca4 tempest-GroupSnapshotsTest-910622332 None] group_snapshot 4b8a49e0-7ff4-4c56-b732-c8b8747030e7: deleted successfully Jul 09 15:17:40 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 Jul 09 15:17:40 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:40 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25.6b01a419-20d1-44a6-8c7a-f6261f69612c" returned: 0 in 0.950s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-6b01a419-20d1-44a6-8c7a-f6261f69612c" released by "_delete_snapshot" :: held 6.740s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" released by "delete_snapshot" :: held 6.771s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Created reservations ['ad57551b-065a-43b5-a238-47c9d8cc96e3', '8dbd023a-8551-4036-94a3-ca2cf896ecff', 'd67534b1-9d43-4672-8286-8f0b2f20da1c', 'e97be679-4a27-4b40-a982-49587997958c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Delete snapshot completed successfully. Jul 09 15:17:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12db0ab2-511d-4675-8112-8830338d0652 tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-6b01a419-20d1-44a6-8c7a-f6261f69612c-delete_snapshot" released by "delete_snapshot" :: held 7.048s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "cinder-quobyte-9df253cd-3763-4d58-bae7-225f3c1ee26c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-9df253cd-3763-4d58-bae7-225f3c1ee26c" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbf7cfb-3a37-45aa-a02a-91e62e49e9da]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:41 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5" returned: 0 in 1.182s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5, size 1024.00 MB, duration 6.91 sec, destination /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.9b04ba2e-ba61-442b-be87-cf6f464117d9pdsiqc_j.img {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:17:41 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Converted 1024.00 MB image at 148.13 MB/s Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] 9b04ba2e-ba61-442b-be87-cf6f464117d9 was raw, no need to convert to raw {{(pid=86916) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 15:17:41 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c Jul 09 15:17:41 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-b3ed8d86-4a78-4248-9ea1-c6093eca9c25-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-b3ed8d86-4a78-4248-9ea1-c6093eca9c25-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:17:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" acquired by "delete_volume" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:17:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce3acb-cccf-42c8-97ee-62e3bb8f3729]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:17:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:42 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 Jul 09 15:17:42 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:42 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c" returned: 0 in 1.048s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:42 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c Jul 09 15:17:42 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:43 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" returned: 0 in 1.002s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:43 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25 Jul 09 15:17:43 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:43 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9df253cd-3763-4d58-bae7-225f3c1ee26c" returned: 0 in 0.804s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Lock "cinder-quobyte-9df253cd-3763-4d58-bae7-225f3c1ee26c" released by "delete_volume" :: held 1.956s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Created reservations ['c5a419d6-8f38-4fa5-af1d-2b121a2464f6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:43 devstack cinder-volume[86916]: WARNING cinder.quota [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-360501876 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-360501876, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Created reservations ['dbf36fef-9fdc-4758-a97d-90d906db6346', '4eaf1a6f-9920-4390-ac7b-86e999b2ec82', '48cd83cb-3eba-43ba-83b6-2bbf2afe4508', '19e6dfaf-870e-4a67-bb19-9433a633edfc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:43 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:17:43 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:44 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" returned: 0 in 1.191s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-quobyte-b3ed8d86-4a78-4248-9ea1-c6093eca9c25" released by "delete_volume" :: held 2.354s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=116,cinder:UPDATE=127,cinder:INSERT=33,cinder:DELETE=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Created reservations ['7f820f56-a44d-4020-b217-feaf70c584e3', 'b23844cb-a763-4d38-b42a-3fca10a78bb7', '741d1702-2f50-4c87-810b-04d9eb1a30d3', 'd0c9943a-c6b9-46d1-97aa-f7798f1bfbb9'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:44 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:17:44 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:44 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.944s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:17:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1e7133e3-87d7-49e1-8e85-00239f918a6c tempest-GroupSnapshotsTest-910622332 None] Delete group completed successfully. Jul 09 15:17:45 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.988s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:45 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:17:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Deleted volume successfully. Jul 09 15:17:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-90c4b34c-2e62-4cff-a117-1c41c9d2651e tempest-VolumesSnapshotListTestJSON-839262604 None] Lock "cinder-b3ed8d86-4a78-4248-9ea1-c6093eca9c25-delete_volume" released by "delete_volume" :: held 3.788s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:17:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:17:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:17:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:17:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:17:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:17:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:17:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:17:47 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:17:47 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:17:48 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 09 15:17:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.053s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:17:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:17:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:17:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:17:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:17:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e9e77a10-788b-4133-872f-097b489575ba tempest-GroupSnapshotsV319Test-1860060506 None] Group tempest-GroupSnapshotsV319Test-Group-86736962: creating Jul 09 15:17:52 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=127,cinder:UPDATE=108,cinder:INSERT=32,cinder:DELETE=5 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:17:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e9e77a10-788b-4133-872f-097b489575ba tempest-GroupSnapshotsV319Test-1860060506 None] Group tempest-GroupSnapshotsV319Test-Group-86736962: created successfully Jul 09 15:17:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e9e77a10-788b-4133-872f-097b489575ba tempest-GroupSnapshotsV319Test-1860060506 None] Create group completed successfully. Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Flow 'volume_create_manager' (36b7aa28-8ce8-4de7-b8c8-5c10bba3be42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab65052c-1585-4881-9aee-85b31b074b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab65052c-1585-4881-9aee-85b31b074b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-516946030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c588e21-b519-4dd0-a8ae-41edd1053ee0,host='devstack@QuobyteHD#QuobyteHD',id=20624ab3-7484-403f-803e-d0e1abd01cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d85e2229ca4af3bf1c6ecb6eb8fae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:55Z,use_quota=True,user_id='9c9d3cc4140a4d5d87f59fc3034fc07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0379f038-bcf0-481a-8193-9a9cfdc0a0c6),volume_type_id=0379f038-bcf0-481a-8193-9a9cfdc0a0c6)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bfa85e-c8dd-4f55-b378-a11935d21048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bfa85e-c8dd-4f55-b378-a11935d21048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d64602d-0f3e-49c4-98bf-9da0efa74fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d64602d-0f3e-49c4-98bf-9da0efa74fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20624ab3-7484-403f-803e-d0e1abd01cb0', 'volume_name': 'volume-20624ab3-7484-403f-803e-d0e1abd01cb0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346b9287-d660-48f0-b998-833b7c53eda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346b9287-d660-48f0-b998-833b7c53eda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e104a0b8-3d36-4262-b803-be8d457b1729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:17:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Volume 20624ab3-7484-403f-803e-d0e1abd01cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20624ab3-7484-403f-803e-d0e1abd01cb0', 'volume_size': 1} Jul 09 15:17:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (3168d148-b259-4b8d-af84-3d467f39e623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58f4a6b-3f4c-4d06-af12-3395aa965cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58f4a6b-3f4c-4d06-af12-3395aa965cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-175402384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a19607-6e5e-48c2-842f-da660f2f0bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:02Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27710eab-6880-44f4-b36a-e0521f78c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27710eab-6880-44f4-b36a-e0521f78c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c176f28e-f4ce-44b4-82e2-d66e890a3e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c176f28e-f4ce-44b4-82e2-d66e890a3e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a19607-6e5e-48c2-842f-da660f2f0bf5', 'volume_name': 'volume-34a19607-6e5e-48c2-842f-da660f2f0bf5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6f90d8-88de-43c0-8a33-e1cb2f77c004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6f90d8-88de-43c0-8a33-e1cb2f77c004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c903bc6e-7121-435a-ac85-6898274555f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Volume 34a19607-6e5e-48c2-842f-da660f2f0bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a19607-6e5e-48c2-842f-da660f2f0bf5', 'volume_size': 1} Jul 09 15:18:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.098s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Uploaded volume to glance image-id: 9b04ba2e-ba61-442b-be87-cf6f464117d9. {{(pid=86916) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.609s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4c588e21-b519-4dd0-a8ae-41edd1053ee0,created_at=2026-07-09T13:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-516946030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c588e21-b519-4dd0-a8ae-41edd1053ee0,host='devstack@QuobyteHD#QuobyteHD',id=20624ab3-7484-403f-803e-d0e1abd01cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d85e2229ca4af3bf1c6ecb6eb8fae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:17:55Z,use_quota=True,user_id='9c9d3cc4140a4d5d87f59fc3034fc07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0379f038-bcf0-481a-8193-9a9cfdc0a0c6),volume_type_id=0379f038-bcf0-481a-8193-9a9cfdc0a0c6)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Creating volume 20624ab3-7484-403f-803e-d0e1abd01cb0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:10 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:18:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-486cfa74-5934-49a5-b4ec-3b32eac377c0 tempest-VolumesActionsTest-1733728859 None] Copy volume to image completed successfully. Jul 09 15:18:10 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 1073741824 Jul 09 15:18:10 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:11 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 1073741824" returned: 0 in 1.058s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:11 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 Jul 09 15:18:11 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:12 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0" returned: 0 in 0.892s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-175402384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a19607-6e5e-48c2-842f-da660f2f0bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:02Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Creating volume 34a19607-6e5e-48c2-842f-da660f2f0bf5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:12 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e104a0b8-3d36-4262-b803-be8d457b1729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20624ab3-7484-403f-803e-d0e1abd01cb0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:12 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5 1073741824 Jul 09 15:18:12 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6587b97d-1ae7-4a32-acfc-506d353f3e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Volume volume-20624ab3-7484-403f-803e-d0e1abd01cb0 (20624ab3-7484-403f-803e-d0e1abd01cb0): created successfully Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6587b97d-1ae7-4a32-acfc-506d353f3e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Flow 'volume_create_manager' (36b7aa28-8ce8-4de7-b8c8-5c10bba3be42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8313fadd-ebd7-46bd-b497-39a11882902f tempest-GroupSnapshotsV319Test-1860060506 None] Created volume successfully. Jul 09 15:18:14 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5 1073741824" returned: 0 in 1.365s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] GroupSnapshot e0743999-d730-4c97-a3a7-db4a17e9bf08: creating. Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Group snapshot e0743999-d730-4c97-a3a7-db4a17e9bf08: creating. {{(pid=86916) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:14 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5 Jul 09 15:18:14 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:14 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5" returned: 0 in 0.707s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.992s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[849ac7f7-1da4-43f7-831d-69dcdbffa20f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c903bc6e-7121-435a-ac85-6898274555f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a19607-6e5e-48c2-842f-da660f2f0bf5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf02ac8-580d-485e-98c1-67a96353119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Volume volume-34a19607-6e5e-48c2-842f-da660f2f0bf5 (34a19607-6e5e-48c2-842f-da660f2f0bf5): created successfully Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf02ac8-580d-485e-98c1-67a96353119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (3168d148-b259-4b8d-af84-3d467f39e623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-915e42db-1dc0-4af8-a4a5-c87e15030c62 tempest-VolumesActionsTest-997215630 None] Created volume successfully. Jul 09 15:18:14 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 Jul 09 15:18:14 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:15 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5" returned: 0 in 0.851s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b53ff47-fb30-4729-8bc6-db4843f5158b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:15 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 Jul 09 15:18:15 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e43c746e-67bc-4015-98a5-61cf195c256a tempest-VolumesActionsTest-997215630 None] Acquiring lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5" by "attach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e43c746e-67bc-4015-98a5-61cf195c256a tempest-VolumesActionsTest-997215630 None] Lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5" acquired by "attach_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e43c746e-67bc-4015-98a5-61cf195c256a tempest-VolumesActionsTest-997215630 None] Attaching volume 34a19607-6e5e-48c2-842f-da660f2f0bf5 to instance 80ced9df-909b-4b57-8828-61aee3d1d48d at mountpoint /dev/vdb on host None. Jul 09 15:18:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e43c746e-67bc-4015-98a5-61cf195c256a tempest-VolumesActionsTest-997215630 None] Attach volume completed successfully. Jul 09 15:18:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e43c746e-67bc-4015-98a5-61cf195c256a tempest-VolumesActionsTest-997215630 None] Lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5" released by "attach_volume" :: held 0.112s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:16 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5" returned: 0 in 0.828s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:16 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img Jul 09 15:18:16 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4147b62f-548b-43a7-abfc-30f32bc80307 tempest-VolumesActionsTest-87012097 None] Terminate volume connection completed successfully. Jul 09 15:18:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4147b62f-548b-43a7-abfc-30f32bc80307 tempest-VolumesActionsTest-87012097 None] Acquiring lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4147b62f-548b-43a7-abfc-30f32bc80307 tempest-VolumesActionsTest-87012097 None] Lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4147b62f-548b-43a7-abfc-30f32bc80307 tempest-VolumesActionsTest-87012097 None] Detaching volume 34a19607-6e5e-48c2-842f-da660f2f0bf5 from instance 80ced9df-909b-4b57-8828-61aee3d1d48d. Jul 09 15:18:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4147b62f-548b-43a7-abfc-30f32bc80307 tempest-VolumesActionsTest-87012097 None] Detach volume completed successfully. Jul 09 15:18:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4147b62f-548b-43a7-abfc-30f32bc80307 tempest-VolumesActionsTest-87012097 None] Lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5-detach_volume" released by "detach_volume" :: held 0.208s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa428e6d-3e25-458b-bf86-c771eddf7f1f tempest-VolumesActionsTest-997215630 None] Acquiring lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5-detach_volume" by "detach_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa428e6d-3e25-458b-bf86-c771eddf7f1f tempest-VolumesActionsTest-997215630 None] Lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aa428e6d-3e25-458b-bf86-c771eddf7f1f tempest-VolumesActionsTest-997215630 None] Volume detach called, but volume not attached. Jul 09 15:18:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa428e6d-3e25-458b-bf86-c771eddf7f1f tempest-VolumesActionsTest-997215630 None] Lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Acquiring lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Acquiring lock "cinder-quobyte-34a19607-6e5e-48c2-842f-da660f2f0bf5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Lock "cinder-quobyte-34a19607-6e5e-48c2-842f-da660f2f0bf5" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd63412-1c0d-4559-a2d3-f8fcc4a3a938]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:20 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5 Jul 09 15:18:20 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:22 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:22 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5" returned: 0 in 2.763s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img" returned: 0 in 6.039s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffcc618-c563-4497-81fd-a33ad32badee]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:22 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5 Jul 09 15:18:22 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:22 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 Jul 09 15:18:22 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:23 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-34a19607-6e5e-48c2-842f-da660f2f0bf5" returned: 0 in 0.819s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Lock "cinder-quobyte-34a19607-6e5e-48c2-842f-da660f2f0bf5" released by "delete_volume" :: held 3.699s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Created reservations ['25d4ae7a-15cf-4aa3-af5a-fa91214d3f8a', '2d36c252-0fa7-4f3a-b36c-9ad3cc284ecb', '1f027f53-2e3d-47bb-a924-fbf2331d41ba', 'e004f432-fca8-4687-b69b-e271529bc572'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:23 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:18:23 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:23 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5" returned: 0 in 1.065s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:18:23 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Converted 1024.00 MB image at 169.26 MB/s Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] 475e17b1-8132-4b11-a1e0-9b92743850bc was raw, converting to qcow2 {{(pid=86916) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec95bd16-fe65-4a0f-a982-7fffa3c98d5a]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:23 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img Jul 09 15:18:23 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:24 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.684s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:24 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Deleted volume successfully. Jul 09 15:18:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5da742e9-f943-40ec-9b48-f870ba465c00 tempest-VolumesActionsTest-997215630 None] Lock "cinder-34a19607-6e5e-48c2-842f-da660f2f0bf5-delete_volume" released by "delete_volume" :: held 4.682s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:24 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img" returned: 0 in 0.795s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:24 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img Jul 09 15:18:24 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:25 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img" returned: 1 in 0.817s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:18:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img /opt/stack/data/cinder/conversion/vol_upload_gmr35qcs {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:25 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img /opt/stack/data/cinder/conversion/vol_upload_gmr35qcs Jul 09 15:18:25 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:25 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img /opt/stack/data/cinder/conversion/vol_upload_gmr35qcs" returned: 0 in 0.701s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:25 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Image conversion details: src /opt/stack/data/cinder/conversion/342e4eb5-a6d9-4950-ace4-00f05410a1d5.temp_image.475e17b1-8132-4b11-a1e0-9b92743850bcyxyf02r6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gmr35qcs {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:18:25 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 09 15:18:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f3176c-643a-4e36-aa81-e510269ba364]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gmr35qcs {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:26 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gmr35qcs Jul 09 15:18:26 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:26 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gmr35qcs" returned: 0 in 0.947s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.709s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Uploaded volume to glance image-id: 475e17b1-8132-4b11-a1e0-9b92743850bc. {{(pid=86916) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 15:18:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.388s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Creating offline snapshot c51f23b7-871e-4e7e-9f43-fa82ec547132 of volume 20624ab3-7484-403f-803e-d0e1abd01cb0 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:18:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-42c84602-8f40-4338-a170-de9de0d3c412 tempest-VolumesActionsTest-1733728859 None] Copy volume to image completed successfully. Jul 09 15:18:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed4bec3-5a8f-4f1b-9eaf-6848d80e0e03]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:28 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 Jul 09 15:18:28 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:29 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0" returned: 0 in 0.806s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Acquiring lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:29 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 1G Jul 09 15:18:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:29 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Acquiring lock "cinder-quobyte-342e4eb5-a6d9-4950-ace4-00f05410a1d5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Lock "cinder-quobyte-342e4eb5-a6d9-4950-ace4-00f05410a1d5" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6b6a1c-a7bb-4098-9868-c00cca0781ca]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:29 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 Jul 09 15:18:29 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:30 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 1G" returned: 0 in 0.894s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20624ab3-7484-403f-803e-d0e1abd01cb0 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:30 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5" returned: 0 in 0.798s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:30 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20624ab3-7484-403f-803e-d0e1abd01cb0 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 Jul 09 15:18:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:30 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:30 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5 Jul 09 15:18:30 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:30 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20624ab3-7484-403f-803e-d0e1abd01cb0 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132" returned: 0 in 0.730s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:30 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:18:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:30 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-342e4eb5-a6d9-4950-ace4-00f05410a1d5" returned: 0 in 0.714s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:30 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 Jul 09 15:18:30 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Lock "cinder-quobyte-342e4eb5-a6d9-4950-ace4-00f05410a1d5" released by "delete_volume" :: held 1.567s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Created reservations ['c53a860b-4d43-45c4-9c43-35f9ac166381', '50750bd5-5499-406a-9142-6a51155ff28c', '8d4b0f0c-9b11-4558-a732-3c53cf9bb9e0', 'b1b0c939-64b7-4176-b3ff-77eeff9edb82'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:31 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:18:31 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:31 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132" returned: 0 in 0.711s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:31 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.info Jul 09 15:18:31 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:31 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.777s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Deleted volume successfully. Jul 09 15:18:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-679fd7b2-08d7-4fc8-a6ff-26850fa72e81 tempest-VolumesActionsTest-1733728859 None] Lock "cinder-342e4eb5-a6d9-4950-ace4-00f05410a1d5-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:32 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.info" returned: 0 in 0.933s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:32 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 15:18:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:32 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.info Jul 09 15:18:32 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:33 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.info" returned: 0 in 0.808s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1692fe05-394d-4f2c-8751-06b3ca8f63c3 tempest-GroupSnapshotsV319Test-1860060506 None] group_snapshot e0743999-d730-4c97-a3a7-db4a17e9bf08: created successfully Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (e4af658a-39c8-4339-aafd-0c664ff81d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc110c4-270f-4d11-ba16-07734dc9119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc110c4-270f-4d11-ba16-07734dc9119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-473554289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c3b8e1-9dfd-4b3e-a803-f1249dcb662e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:34Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f673672-f1bc-4cfb-ae1d-f7fc7d43e9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f673672-f1bc-4cfb-ae1d-f7fc7d43e9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ded311a-0610-4525-9720-8cfb0973e079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ded311a-0610-4525-9720-8cfb0973e079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c3b8e1-9dfd-4b3e-a803-f1249dcb662e', 'volume_name': 'volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc03128-b9f1-4b14-b104-54fd8e8607c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc03128-b9f1-4b14-b104-54fd8e8607c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4762496-29b9-4280-9585-fd1820242457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Volume 36c3b8e1-9dfd-4b3e-a803-f1249dcb662e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e', 'volume_size': 1} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-473554289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c3b8e1-9dfd-4b3e-a803-f1249dcb662e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:34Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Creating volume 36c3b8e1-9dfd-4b3e-a803-f1249dcb662e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:34 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:34 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e 1073741824 Jul 09 15:18:34 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] group_snapshot e0743999-d730-4c97-a3a7-db4a17e9bf08: deleting Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] group_snapshot e0743999-d730-4c97-a3a7-db4a17e9bf08: deleting {{(pid=86916) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Acquiring lock "cinder-quobyte-20624ab3-7484-403f-803e-d0e1abd01cb0" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Lock "cinder-quobyte-20624ab3-7484-403f-803e-d0e1abd01cb0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Acquiring lock "cinder-quobyte-c51f23b7-871e-4e7e-9f43-fa82ec547132" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Lock "cinder-quobyte-c51f23b7-871e-4e7e-9f43-fa82ec547132" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Deleting offline snapshot c51f23b7-871e-4e7e-9f43-fa82ec547132 of volume 20624ab3-7484-403f-803e-d0e1abd01cb0 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:18:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] snapshot_file for this snap is: volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:18:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[671c5b0b-6eaa-4e37-bc55-451d2eda0db4]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:35 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 Jul 09 15:18:35 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:35 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e 1073741824" returned: 0 in 1.159s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:35 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e Jul 09 15:18:35 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:36 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132" returned: 0 in 0.908s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20624ab3-7484-403f-803e-d0e1abd01cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d05563-6d8c-4be5-aa8d-c64b485e5f98]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:36 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 Jul 09 15:18:36 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:36 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e" returned: 0 in 0.887s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4762496-29b9-4280-9585-fd1820242457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f674b3a9-8114-4e41-be44-1fb97ad5020c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Volume volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e (36c3b8e1-9dfd-4b3e-a803-f1249dcb662e): created successfully Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f674b3a9-8114-4e41-be44-1fb97ad5020c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (e4af658a-39c8-4339-aafd-0c664ff81d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ba41e06e-f9b9-42ef-bbba-bcc43219f506 tempest-VolumesActionsTest-997215630 None] Created volume successfully. Jul 09 15:18:37 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0" returned: 0 in 1.019s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:37 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 Jul 09 15:18:37 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Acquiring lock "cinder-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Lock "cinder-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Acquiring lock "cinder-quobyte-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Lock "cinder-quobyte-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ba3ad1-136c-4e30-a24e-2333fc258210]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:38 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e Jul 09 15:18:38 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:38 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132" returned: 0 in 1.403s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:38 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132 Jul 09 15:18:38 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:39 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e" returned: 0 in 1.110s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:39 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e Jul 09 15:18:39 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:39 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0.c51f23b7-871e-4e7e-9f43-fa82ec547132" returned: 0 in 0.845s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Lock "cinder-quobyte-c51f23b7-871e-4e7e-9f43-fa82ec547132" released by "_delete_snapshot" :: held 4.369s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Lock "cinder-quobyte-20624ab3-7484-403f-803e-d0e1abd01cb0" released by "delete_snapshot" :: held 4.414s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:39 devstack cinder-volume[86916]: WARNING cinder.quota [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-337030067 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-337030067, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:18:39 devstack cinder-volume[86916]: WARNING cinder.quota [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-337030067 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-337030067, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:18:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] Created reservations ['9f2a1b6a-88ea-4540-ab66-91bb8166f428', 'b2bfca3a-e07c-4988-ae75-edf458417da6', '75fd4a99-eadf-431c-b036-67a9facaf7c4', '5bf2e13d-ac24-4fff-87fe-23dc90d4586a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-10e31259-2919-4154-b444-feee59e2dea2 tempest-GroupSnapshotsV319Test-1860060506 None] group_snapshot e0743999-d730-4c97-a3a7-db4a17e9bf08: deleted successfully Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Acquiring lock "cinder-quobyte-20624ab3-7484-403f-803e-d0e1abd01cb0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Lock "cinder-quobyte-20624ab3-7484-403f-803e-d0e1abd01cb0" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[40875b59-db4d-4fea-8871-a6652b0fcc32]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:40 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 Jul 09 15:18:40 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:40 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e" returned: 0 in 0.996s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Lock "cinder-quobyte-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e" released by "delete_volume" :: held 2.183s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Created reservations ['96f0f3bb-fe18-43dd-a6f4-c7d75a1a9d20', '004d556f-0618-44c1-a7f5-8812e1871e75', 'fa5deffb-229a-4566-9748-fa837c271c66', 'aceda6cf-5979-4d42-a0d5-341c7cf05893'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:40 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:18:40 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Flow 'volume_create_manager' (25007429-5fc0-4a7b-8445-eb2f96b2a6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac40464-cc8e-49bf-ab98-fcf9bd951126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac40464-cc8e-49bf-ab98-fcf9bd951126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1636001200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947cc904-cb51-4024-bf1a-841b75a3e550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030360ed59ec4f36b1604411a356bc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:41Z,use_quota=True,user_id='f0823711f8b945188c36abd173cf3884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37ffc19-13bd-4457-a077-e27349baeb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37ffc19-13bd-4457-a077-e27349baeb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec909cfd-658d-443d-a05b-498d9565c017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec909cfd-658d-443d-a05b-498d9565c017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947cc904-cb51-4024-bf1a-841b75a3e550', 'volume_name': 'volume-947cc904-cb51-4024-bf1a-841b75a3e550', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41d3c9f-c090-4efa-a970-9e8e3f9c8837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41d3c9f-c090-4efa-a970-9e8e3f9c8837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205acfb3-e899-4db3-aaa4-431d1a18f42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Volume 947cc904-cb51-4024-bf1a-841b75a3e550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947cc904-cb51-4024-bf1a-841b75a3e550', 'volume_size': 1} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1636001200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947cc904-cb51-4024-bf1a-841b75a3e550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030360ed59ec4f36b1604411a356bc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:41Z,use_quota=True,user_id='f0823711f8b945188c36abd173cf3884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Creating volume 947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:41 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:41 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0" returned: 0 in 1.202s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:41 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 1073741824 Jul 09 15:18:41 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:41 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0 Jul 09 15:18:41 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:41 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.121s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Deleted volume successfully. Jul 09 15:18:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-18da6959-7a83-4826-aa44-632bcf9f2bae tempest-VolumesActionsTest-87012097 None] Lock "cinder-36c3b8e1-9dfd-4b3e-a803-f1249dcb662e-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (5dbf4979-ecb4-4a2e-9377-89532d393a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:42 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36879d61-4ddf-4a23-bb03-31e7ed120286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-20624ab3-7484-403f-803e-d0e1abd01cb0" returned: 0 in 1.118s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Lock "cinder-quobyte-20624ab3-7484-403f-803e-d0e1abd01cb0" released by "delete_volume" :: held 2.431s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36879d61-4ddf-4a23-bb03-31e7ed120286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1820352832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:42Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dee995-b151-494e-944c-10c7d67b6aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dee995-b151-494e-944c-10c7d67b6aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54861c48-f3c2-4be3-b546-2d428d1d7d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54861c48-f3c2-4be3-b546-2d428d1d7d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc', 'volume_name': 'volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff011b8-44f0-45de-8dfc-8eb4947859cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff011b8-44f0-45de-8dfc-8eb4947859cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b979aae-86b2-41a3-8f04-243d7b10d6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Volume fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc', 'volume_size': 1} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Created reservations ['a5b35a3e-024d-452e-acd2-7104abde6f26'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:42 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 1073741824" returned: 0 in 1.425s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:42 devstack cinder-volume[86916]: WARNING cinder.quota [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-337030067 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-337030067, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Created reservations ['0c1dc9a2-26ca-4634-ab51-b54e09a46d3a', '867ad0fa-66cf-4489-b2d2-793b1d1d5ba5', 'ebd74b6d-0a1a-4c03-aef8-1d03db3d1581', '963bcbfc-8cb9-4994-ae81-f727e3e60823'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:42 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 Jul 09 15:18:42 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:43 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:18:43 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:43 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.985s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f50e3a6a-7178-4aa7-99e3-f9a3e0c61261 tempest-GroupSnapshotsV319Test-1860060506 None] Delete group completed successfully. Jul 09 15:18:43 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550" returned: 0 in 1.157s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] <== create_volume: return (2655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.660s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.385s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1820352832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:42Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Creating volume fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:43 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:18:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205acfb3-e899-4db3-aaa4-431d1a18f42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947cc904-cb51-4024-bf1a-841b75a3e550', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc 1073741824 Jul 09 15:18:44 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2555007-3b6d-4067-91fb-cf41ee0b81b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Volume volume-947cc904-cb51-4024-bf1a-841b75a3e550 (947cc904-cb51-4024-bf1a-841b75a3e550): created successfully Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2555007-3b6d-4067-91fb-cf41ee0b81b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Flow 'volume_create_manager' (25007429-5fc0-4a7b-8445-eb2f96b2a6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f12e0f37-9c80-40f5-aea7-3625d0508c0f tempest-VolumesCloneTest-1710368728 None] Created volume successfully. Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Flow 'volume_create_manager' (ce8f9af5-3fc7-4c0e-98ac-58450be97a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6d0918-ec71-4196-8985-b7aa8ac7f941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6d0918-ec71-4196-8985-b7aa8ac7f941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-239260097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc62afd-f14a-4151-bb60-a0a4c95cdda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89008feb553f4bff8c75cd99d69954a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:44Z,use_quota=True,user_id='d57352c7c2a94242b8cf4e5632282d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de72869d-1a7b-4f61-beb4-67c310ef62ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de72869d-1a7b-4f61-beb4-67c310ef62ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc75ce7-8a9b-48a6-9999-b26da24664d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc75ce7-8a9b-48a6-9999-b26da24664d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc62afd-f14a-4151-bb60-a0a4c95cdda1', 'volume_name': 'volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82e458f-1af3-4c21-879b-6e57d3fc4aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82e458f-1af3-4c21-879b-6e57d3fc4aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a6793f-68e6-4651-976d-0ca993917992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Volume ebc62afd-f14a-4151-bb60-a0a4c95cdda1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1', 'volume_size': 1} Jul 09 15:18:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=77,cinder:SELECT=53,cinder:DELETE=5,cinder:INSERT=15 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Flow 'volume_create_manager' (a1815e9f-afac-44cc-b56a-a142fa681737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57a0ee9-26d0-4e42-9314-78bd1251d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57a0ee9-26d0-4e42-9314-78bd1251d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1694955320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b63463-1453-4855-8c4c-dcbccbc2e7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030360ed59ec4f36b1604411a356bc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=947cc904-cb51-4024-bf1a-841b75a3e550,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:45Z,use_quota=True,user_id='f0823711f8b945188c36abd173cf3884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c7fc2d-df37-4139-b1be-9e159fa1182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c7fc2d-df37-4139-b1be-9e159fa1182a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61709c36-b7ab-4cef-bed0-3d9b5187613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61709c36-b7ab-4cef-bed0-3d9b5187613b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '65b63463-1453-4855-8c4c-dcbccbc2e7dc', 'volume_name': 'volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc', 'volume_size': 2, 'source_volid': '947cc904-cb51-4024-bf1a-841b75a3e550', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57868527-cfbd-4020-b863-cd4079bd5d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57868527-cfbd-4020-b863-cd4079bd5d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0150ea32-1688-486a-b5e4-62181cbafa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Volume 65b63463-1453-4855-8c4c-dcbccbc2e7dc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc', 'volume_size': 2, 'source_volid': '947cc904-cb51-4024-bf1a-841b75a3e550', 'source_volstatus': 'available'} Jul 09 15:18:45 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc 1073741824" returned: 0 in 1.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:45 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc Jul 09 15:18:45 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:46 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc" returned: 0 in 0.821s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.739s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-239260097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc62afd-f14a-4151-bb60-a0a4c95cdda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89008feb553f4bff8c75cd99d69954a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:44Z,use_quota=True,user_id='d57352c7c2a94242b8cf4e5632282d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Creating volume ebc62afd-f14a-4151-bb60-a0a4c95cdda1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:18:46 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b979aae-86b2-41a3-8f04-243d7b10d6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9297cb35-4cec-4121-94cb-41381a2b5d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:46 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 1073741824 Jul 09 15:18:46 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Volume volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc (fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc): created successfully Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9297cb35-4cec-4121-94cb-41381a2b5d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (5dbf4979-ecb4-4a2e-9377-89532d393a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aad81f51-3893-4fb9-8641-034bcea11c2a tempest-VolumesActionsTest-997215630 None] Created volume successfully. Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Acquiring lock "cinder-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Lock "cinder-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Acquiring lock "cinder-quobyte-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Lock "cinder-quobyte-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc09c05d-3899-4325-8811-6366c35aacec]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:47 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc Jul 09 15:18:47 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:47 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 1073741824" returned: 0 in 1.283s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:47 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 Jul 09 15:18:47 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:47 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:18:47 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:48 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc" returned: 0 in 1.123s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:48 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc Jul 09 15:18:48 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:48 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1" returned: 0 in 0.996s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] <== create_volume: return (2342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.347s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.222s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:48 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Cloning volume 947cc904-cb51-4024-bf1a-841b75a3e550 to volume 65b63463-1453-4855-8c4c-dcbccbc2e7dc Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a6793f-68e6-4651-976d-0ca993917992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31883d11-0df1-4507-9d62-705763e4a727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Volume volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 (ebc62afd-f14a-4151-bb60-a0a4c95cdda1): created successfully Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31883d11-0df1-4507-9d62-705763e4a727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Flow 'volume_create_manager' (ce8f9af5-3fc7-4c0e-98ac-58450be97a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Creating offline snapshot afca1b0e-a811-4b83-9f48-7bd0f3a96412 of volume 947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:18:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-696154ab-60bb-438a-8fcf-2301862bf2bf tempest-TestMinimumBasicScenario-1727053900 None] Created volume successfully. Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4218957-8041-4339-8eb3-d48927ea40c1]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:48 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 Jul 09 15:18:48 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:49 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.374s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:18:49 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc" returned: 0 in 0.983s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Lock "cinder-quobyte-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc" released by "delete_volume" :: held 2.161s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Created reservations ['4fcb2415-d246-4f51-ba0f-26240e59f86b', '1d0f917a-a2d8-491a-ad7b-e4e6487716ad', '459c730b-967c-4c02-ac59-43646dd77b63', 'e4a5317a-5b50-4eec-99f8-49407d6de689'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:49 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:18:49 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:49 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550" returned: 0 in 1.189s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:49 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 1G Jul 09 15:18:49 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:50 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.824s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:50 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:18:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Deleted volume successfully. Jul 09 15:18:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-037d00ee-1611-46fb-a785-81d1b2dcf93b tempest-VolumesActionsTest-87012097 None] Lock "cinder-fcf5a8bb-8695-46c6-a17f-c2a9a89bcbbc-delete_volume" released by "delete_volume" :: held 3.372s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:18:51 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 1G" returned: 0 in 1.184s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947cc904-cb51-4024-bf1a-841b75a3e550 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:51 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947cc904-cb51-4024-bf1a-841b75a3e550 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 Jul 09 15:18:51 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (fc52d620-7a1c-47a7-a8ca-b1e3ce576d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb2396d-0808-47cb-a6d0-abfb45b64299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb2396d-0808-47cb-a6d0-abfb45b64299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1555239962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdcc9ae-a72c-4538-af78-f9d1783bf2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:51Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cec368-16af-4e37-bbf9-86f8455cd849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cec368-16af-4e37-bbf9-86f8455cd849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2590e4f0-be00-4cd5-b54e-bd3edc236c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2590e4f0-be00-4cd5-b54e-bd3edc236c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fdcc9ae-a72c-4538-af78-f9d1783bf2cd', 'volume_name': 'volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd63e6da-6afa-41d7-b0f8-f18c4ec6a4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd63e6da-6afa-41d7-b0f8-f18c4ec6a4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3d7eeb-bd90-427a-837d-e402eca1f345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:18:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Volume 1fdcc9ae-a72c-4538-af78-f9d1783bf2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd', 'volume_size': 1} Jul 09 15:18:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:52 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947cc904-cb51-4024-bf1a-841b75a3e550 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412" returned: 0 in 1.175s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:52 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 is being set with open permissions: ugo+rw Jul 09 15:18:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:52 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 Jul 09 15:18:52 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:53 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412" returned: 0 in 0.894s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:53 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=65,cinder:SELECT=78,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:18:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:53 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.info Jul 09 15:18:53 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-3eacf22a-4293-4401-9374-1daa4a060c94 req-bbfc73d2-bb7d-4aa0-9c47-da1fc059e4bd tempest-TestMinimumBasicScenario-1727053900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:53 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.info" returned: 0 in 0.726s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:53 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.info is being set with open permissions: ugo+rw Jul 09 15:18:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:53 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.info Jul 09 15:18:53 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:54 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.info" returned: 0 in 0.660s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Acquiring lock "cinder-quobyte-65b63463-1453-4855-8c4c-dcbccbc2e7dc" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Lock "cinder-quobyte-65b63463-1453-4855-8c4c-dcbccbc2e7dc" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] snapshot: afca1b0e-a811-4b83-9f48-7bd0f3a96412, volume: 65b63463-1453-4855-8c4c-dcbccbc2e7dc, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c6a5a-d280-4004-abab-4351f09c1896]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:54 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 Jul 09 15:18:54 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:55 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412" returned: 0 in 0.760s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-947cc904-cb51-4024-bf1a-841b75a3e550(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:18:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:18:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:18:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[786302be-ace3-447e-ace1-3c9ec431453d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:18:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:55 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 Jul 09 15:18:55 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:18:56 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 09 15:18:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550" returned: 0 in 0.794s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:18:56 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:18:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:18:56 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc Jul 09 15:18:56 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:01 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc" returned: 0 in 5.733s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[19054fa8-0d27-4a85-81e1-0805aa220c94]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:02 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 Jul 09 15:19:02 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:03 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550" returned: 0 in 1.095s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:19:03 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Converted 1024.00 MB image at 178.59 MB/s Jul 09 15:19:03 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc is being set with open permissions: ugo+rw Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:03 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc Jul 09 15:19:03 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=10,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:19:03 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc" returned: 0 in 0.702s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Lock "cinder-quobyte-65b63463-1453-4855-8c4c-dcbccbc2e7dc" released by "_copy_volume_from_snapshot" :: held 9.184s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Acquiring lock "cinder-quobyte-afca1b0e-a811-4b83-9f48-7bd0f3a96412" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Lock "cinder-quobyte-afca1b0e-a811-4b83-9f48-7bd0f3a96412" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Deleting offline snapshot afca1b0e-a811-4b83-9f48-7bd0f3a96412 of volume 947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] snapshot_file for this snap is: volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c6243d-e3af-4e5d-ad1b-3578151068bc]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:03 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 Jul 09 15:19:03 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:04 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412" returned: 0 in 0.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-947cc904-cb51-4024-bf1a-841b75a3e550(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:19:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa17ff29-8a11-45b5-87ce-62fbff55563e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:04 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 Jul 09 15:19:04 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:05 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550" returned: 0 in 0.778s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:05 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 Jul 09 15:19:05 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:06 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412" returned: 0 in 0.760s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:06 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412 Jul 09 15:19:06 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:06 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550.afca1b0e-a811-4b83-9f48-7bd0f3a96412" returned: 0 in 0.732s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Lock "cinder-quobyte-afca1b0e-a811-4b83-9f48-7bd0f3a96412" released by "_delete_snapshot" :: held 3.187s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.501s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.420s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1555239962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdcc9ae-a72c-4538-af78-f9d1783bf2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:18:51Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Creating volume 1fdcc9ae-a72c-4538-af78-f9d1783bf2cd {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:07 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0150ea32-1688-486a-b5e4-62181cbafa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc', 'volume_size': 2, 'source_volid': '947cc904-cb51-4024-bf1a-841b75a3e550', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:07 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd 1073741824 Jul 09 15:19:07 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed7ae55-28be-4c78-a47c-f253edaf6705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Volume volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc (65b63463-1453-4855-8c4c-dcbccbc2e7dc): created successfully Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed7ae55-28be-4c78-a47c-f253edaf6705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Flow 'volume_create_manager' (a1815e9f-afac-44cc-b56a-a142fa681737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-42c10e07-8c10-41cb-ba29-e0c676f60a6f tempest-VolumesCloneTest-1710368728 None] Created volume successfully. Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Acquiring lock "cinder-65b63463-1453-4855-8c4c-dcbccbc2e7dc-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Lock "cinder-65b63463-1453-4855-8c4c-dcbccbc2e7dc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Acquiring lock "cinder-quobyte-65b63463-1453-4855-8c4c-dcbccbc2e7dc" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Lock "cinder-quobyte-65b63463-1453-4855-8c4c-dcbccbc2e7dc" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[40544af7-543b-4cef-86bb-3e4499a906d0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:07 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc Jul 09 15:19:07 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:07 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd 1073741824" returned: 0 in 0.970s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:08 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd Jul 09 15:19:08 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:08 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc" returned: 0 in 0.820s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:08 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc Jul 09 15:19:08 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:08 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd" returned: 0 in 0.706s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-3eacf22a-4293-4401-9374-1daa4a060c94 req-bbfc73d2-bb7d-4aa0-9c47-da1fc059e4bd tempest-TestMinimumBasicScenario-1727053900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.495s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3d7eeb-bd90-427a-837d-e402eca1f345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9997499c-b63a-4375-96c2-509ef8974575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7859206-73ec-485f-80f3-01a5ec661789]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-3eacf22a-4293-4401-9374-1daa4a060c94 req-bbfc73d2-bb7d-4aa0-9c47-da1fc059e4bd tempest-TestMinimumBasicScenario-1727053900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Volume volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd (1fdcc9ae-a72c-4538-af78-f9d1783bf2cd): created successfully Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9997499c-b63a-4375-96c2-509ef8974575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (fc52d620-7a1c-47a7-a8ca-b1e3ce576d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3362127c-4019-4c54-b6df-4acf839ed14a tempest-VolumesActionsTest-997215630 None] Created volume successfully. Jul 09 15:19:08 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 Jul 09 15:19:08 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:09 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-65b63463-1453-4855-8c4c-dcbccbc2e7dc" returned: 0 in 0.741s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Lock "cinder-quobyte-65b63463-1453-4855-8c4c-dcbccbc2e7dc" released by "delete_volume" :: held 1.604s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Created reservations ['00bea23a-562f-4a05-a40e-d990540bc1a3', '53450684-7f7a-4831-9624-055f06390c51', 'f79463e4-0f8f-434a-838f-9691e2f90929', 'f6c91b79-30d1-471d-9f46-d4663079fa49'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:09 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:19:09 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Acquiring lock "cinder-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Lock "cinder-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:09 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-3eacf22a-4293-4401-9374-1daa4a060c94 req-bbfc73d2-bb7d-4aa0-9c47-da1fc059e4bd tempest-TestMinimumBasicScenario-1727053900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1" returned: 0 in 0.908s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-3eacf22a-4293-4401-9374-1daa4a060c94 req-bbfc73d2-bb7d-4aa0-9c47-da1fc059e4bd tempest-TestMinimumBasicScenario-1727053900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.946s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Acquiring lock "cinder-quobyte-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-3eacf22a-4293-4401-9374-1daa4a060c94 req-bbfc73d2-bb7d-4aa0-9c47-da1fc059e4bd tempest-TestMinimumBasicScenario-1727053900 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bb72180-7a8c-4464-8592-ccd47b780288', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Lock "cinder-quobyte-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae6c6b4-84be-4ef4-a391-49581cd7a649]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-3eacf22a-4293-4401-9374-1daa4a060c94 req-bbfc73d2-bb7d-4aa0-9c47-da1fc059e4bd tempest-TestMinimumBasicScenario-1727053900 None] attachment_update completed successfully. Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Acquiring lock "cinder-947cc904-cb51-4024-bf1a-841b75a3e550-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:09 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd Jul 09 15:19:09 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Lock "cinder-947cc904-cb51-4024-bf1a-841b75a3e550-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Acquiring lock "cinder-quobyte-947cc904-cb51-4024-bf1a-841b75a3e550" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Lock "cinder-quobyte-947cc904-cb51-4024-bf1a-841b75a3e550" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72ce6d2-2c6d-4554-a602-b9e601f03db5]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:10 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 Jul 09 15:19:10 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:10 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.987s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Deleted volume successfully. Jul 09 15:19:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2b4bcf07-3a9a-4b53-b56d-aeeb7494a1f4 tempest-VolumesCloneTest-1710368728 None] Lock "cinder-65b63463-1453-4855-8c4c-dcbccbc2e7dc-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:10 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd" returned: 0 in 1.014s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:10 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd Jul 09 15:19:10 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:11 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550" returned: 0 in 0.982s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:11 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550 Jul 09 15:19:11 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:11 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd" returned: 0 in 0.769s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Lock "cinder-quobyte-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd" released by "delete_volume" :: held 1.857s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Created reservations ['571b0035-1a2e-4908-bd0c-41d162baf0e1', '3ba96e7d-698b-47b7-a06b-7791e6944363', '4be748b1-6390-4311-9fbb-27af6477ec0f', 'c488db99-bbfb-45ae-8095-8fbf1755c0c2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:11 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:19:11 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:11 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-947cc904-cb51-4024-bf1a-841b75a3e550" returned: 0 in 0.794s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Lock "cinder-quobyte-947cc904-cb51-4024-bf1a-841b75a3e550" released by "delete_volume" :: held 1.875s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Created reservations ['125a52eb-4044-485f-91cd-232489e43d8f', '7e594d8f-0401-402c-8b67-cb3ab1491741', '1cb5dbe0-6887-4931-9130-8961a73d52b6', 'b12255f0-7ded-45af-a2b8-ce58e2fe3b1f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:12 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:19:12 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (267fd70b-c54b-4927-985f-414469379d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a67b0b-6e40-4d83-a62e-8fe35fc7add3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a67b0b-6e40-4d83-a62e-8fe35fc7add3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1835340586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30611e79-b978-487a-9866-9c0493a04d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:13Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:12 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691cddba-b2a5-4de5-a326-7c7319403302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691cddba-b2a5-4de5-a326-7c7319403302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56cd361-25df-4d2a-ab1a-d1c9ad1f2979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56cd361-25df-4d2a-ab1a-d1c9ad1f2979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30611e79-b978-487a-9866-9c0493a04d81', 'volume_name': 'volume-30611e79-b978-487a-9866-9c0493a04d81', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2f860d-83c3-4904-9c6b-9dfe2460ea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2f860d-83c3-4904-9c6b-9dfe2460ea71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e90b43-a05b-400f-9350-82e2970d8f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Volume 30611e79-b978-487a-9866-9c0493a04d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30611e79-b978-487a-9866-9c0493a04d81', 'volume_size': 1} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1835340586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30611e79-b978-487a-9866-9c0493a04d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:13Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Creating volume 30611e79-b978-487a-9866-9c0493a04d81 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:12 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.118s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Deleted volume successfully. Jul 09 15:19:12 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81 1073741824 Jul 09 15:19:12 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-88ebd8f3-80ee-4d90-92b7-14ebefc2ea3f tempest-VolumesActionsTest-87012097 None] Lock "cinder-1fdcc9ae-a72c-4538-af78-f9d1783bf2cd-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:13 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.176s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Deleted volume successfully. Jul 09 15:19:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f41f83a7-2ff2-4d82-a6e7-16a3bd561635 tempest-VolumesCloneTest-1710368728 None] Lock "cinder-947cc904-cb51-4024-bf1a-841b75a3e550-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:13 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81 1073741824" returned: 0 in 1.039s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:13 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81 Jul 09 15:19:13 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Flow 'volume_create_manager' (bd94bf27-bb4c-4dc4-8929-567e0e5987b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6533345e-e93a-4928-be46-e8814f69d7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6533345e-e93a-4928-be46-e8814f69d7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-183484581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f471268-f84e-4a09-b52c-9a951ec8f334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562f1a49fc764ed5b2a350eea9ecdfc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:14Z,use_quota=True,user_id='265a722f3423447990db90ec61d7f287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6c3119-dfe7-410a-bf76-ad553cff517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6c3119-dfe7-410a-bf76-ad553cff517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef833b41-0901-466e-aaac-bb1286a7753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef833b41-0901-466e-aaac-bb1286a7753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f471268-f84e-4a09-b52c-9a951ec8f334', 'volume_name': 'volume-8f471268-f84e-4a09-b52c-9a951ec8f334', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4ff9a1-a934-4a83-8243-742b9ab4d0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4ff9a1-a934-4a83-8243-742b9ab4d0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7649948-73cf-4e65-9938-03890d4549a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Volume 8f471268-f84e-4a09-b52c-9a951ec8f334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f471268-f84e-4a09-b52c-9a951ec8f334', 'volume_size': 2} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:14 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81" returned: 0 in 0.727s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.164s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-183484581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f471268-f84e-4a09-b52c-9a951ec8f334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562f1a49fc764ed5b2a350eea9ecdfc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:14Z,use_quota=True,user_id='265a722f3423447990db90ec61d7f287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Creating volume 8f471268-f84e-4a09-b52c-9a951ec8f334 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334 2147483648 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e90b43-a05b-400f-9350-82e2970d8f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30611e79-b978-487a-9866-9c0493a04d81', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:14 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334 2147483648 Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67992f30-b814-46fe-bed3-ff0c7af6dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:14 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Volume volume-30611e79-b978-487a-9866-9c0493a04d81 (30611e79-b978-487a-9866-9c0493a04d81): created successfully Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67992f30-b814-46fe-bed3-ff0c7af6dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (267fd70b-c54b-4927-985f-414469379d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-98395d18-c272-4f38-86ff-342887704e43 tempest-VolumesActionsTest-997215630 None] Created volume successfully. Jul 09 15:19:15 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334 2147483648" returned: 0 in 1.015s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:15 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334 Jul 09 15:19:15 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Flow 'volume_create_manager' (935d7a1a-cd7b-40e9-8041-3db66b2c5811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87cdf94-19e3-40bb-b494-ca4950a5d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Acquiring lock "cinder-30611e79-b978-487a-9866-9c0493a04d81-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87cdf94-19e3-40bb-b494-ca4950a5d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-443959733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3dcf81f-cbff-4a68-ab35-29b6f1976aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78faf9f5455a4fb595695c61b06722d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:16Z,use_quota=True,user_id='c6221ed81ce041b98bbeec4875d3ced5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7263dbda-5b9b-45ef-a606-d074587af800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7263dbda-5b9b-45ef-a606-d074587af800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba44be6e-e1d3-4fc6-ae69-c4876a1be7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba44be6e-e1d3-4fc6-ae69-c4876a1be7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3dcf81f-cbff-4a68-ab35-29b6f1976aa0', 'volume_name': 'volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8cbed0-00bc-43d0-881b-08e5fc87198c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8cbed0-00bc-43d0-881b-08e5fc87198c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e88d64-7912-43db-ab53-2250ee01266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Volume f3dcf81f-cbff-4a68-ab35-29b6f1976aa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0', 'volume_size': 2} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Lock "cinder-30611e79-b978-487a-9866-9c0493a04d81-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Acquiring lock "cinder-quobyte-30611e79-b978-487a-9866-9c0493a04d81" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Lock "cinder-quobyte-30611e79-b978-487a-9866-9c0493a04d81" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a35d7e-1ad4-4a5e-8d0f-0aeda4e0f532]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:16 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81 Jul 09 15:19:16 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:16 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334" returned: 0 in 0.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-443959733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3dcf81f-cbff-4a68-ab35-29b6f1976aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78faf9f5455a4fb595695c61b06722d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:16Z,use_quota=True,user_id='c6221ed81ce041b98bbeec4875d3ced5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Creating volume f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:16 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 2147483648 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7649948-73cf-4e65-9938-03890d4549a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f471268-f84e-4a09-b52c-9a951ec8f334', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:16 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 2147483648 Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc49d2be-efc4-47cb-988b-5983b978d643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:16 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Volume volume-8f471268-f84e-4a09-b52c-9a951ec8f334 (8f471268-f84e-4a09-b52c-9a951ec8f334): created successfully Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc49d2be-efc4-47cb-988b-5983b978d643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Flow 'volume_create_manager' (bd94bf27-bb4c-4dc4-8929-567e0e5987b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-478a6680-eb71-4daf-b96e-db778c6f4ed1 tempest-VolumesCloneNegativeTest-984674636 None] Created volume successfully. Jul 09 15:19:16 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81" returned: 0 in 0.875s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:17 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81 Jul 09 15:19:17 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:17 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 2147483648" returned: 0 in 1.049s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:17 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 Jul 09 15:19:17 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:17 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Acquiring lock "cinder-8f471268-f84e-4a09-b52c-9a951ec8f334-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30611e79-b978-487a-9866-9c0493a04d81" returned: 0 in 0.862s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Lock "cinder-quobyte-30611e79-b978-487a-9866-9c0493a04d81" released by "delete_volume" :: held 1.780s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Lock "cinder-8f471268-f84e-4a09-b52c-9a951ec8f334-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Acquiring lock "cinder-quobyte-8f471268-f84e-4a09-b52c-9a951ec8f334" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Lock "cinder-quobyte-8f471268-f84e-4a09-b52c-9a951ec8f334" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05260a3-7d6c-4b6a-ac35-b993b8316bfb]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Created reservations ['eacd6a39-dc86-4727-8647-2c90135fb1b9', 'c7409e82-8360-40e3-848b-a80d1fb9e844', 'f7567dac-28fa-459a-9418-80b095a58a49', 'fbef9994-866d-442c-9c2b-3717f1a95160'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:18 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334 Jul 09 15:19:18 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:18 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:19:18 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:18 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" returned: 0 in 1.177s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] <== create_volume: return (2319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e88d64-7912-43db-ab53-2250ee01266c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0', 'volume_size': 2}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e636f1-3778-48c1-b745-883591da548b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:18 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334" returned: 0 in 0.982s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:19 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334 Jul 09 15:19:19 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Volume volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 (f3dcf81f-cbff-4a68-ab35-29b6f1976aa0): created successfully Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e636f1-3778-48c1-b745-883591da548b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Flow 'volume_create_manager' (935d7a1a-cd7b-40e9-8041-3db66b2c5811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-60588a77-e846-4131-bedf-3d7bc5b33357 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Created volume successfully. Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (ee89688d-8d50-40d4-8556-ce089bd6cb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed24e344-4b82-4f66-96cf-1d16896cd762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:19 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed24e344-4b82-4f66-96cf-1d16896cd762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-879896454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449fd0e8-aca9-439e-83aa-13b26fb3e0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:19Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f647c41b-6cc6-42ef-a9e8-d2b2e907ef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f647c41b-6cc6-42ef-a9e8-d2b2e907ef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da8ec3c-695a-4760-a54a-85ce3d214b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da8ec3c-695a-4760-a54a-85ce3d214b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449fd0e8-aca9-439e-83aa-13b26fb3e0ac', 'volume_name': 'volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6d5d03-9bca-4848-b542-37a8195a6c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6d5d03-9bca-4848-b542-37a8195a6c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4374c6c3-7ca7-4ccc-a07f-a1f018ae4d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Volume 449fd0e8-aca9-439e-83aa-13b26fb3e0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac', 'volume_size': 1} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-879896454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449fd0e8-aca9-439e-83aa-13b26fb3e0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ac8b17a5140a7a5448715f6bffc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:19Z,use_quota=True,user_id='aa2e5e9af8864181b350049eb939e419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Creating volume 449fd0e8-aca9-439e-83aa-13b26fb3e0ac {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:19 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.280s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Deleted volume successfully. Jul 09 15:19:19 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac 1073741824 Jul 09 15:19:19 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41c1c983-882c-4331-98b0-bc01dcaf1f8a tempest-VolumesActionsTest-87012097 None] Lock "cinder-30611e79-b978-487a-9866-9c0493a04d81-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:19 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f471268-f84e-4a09-b52c-9a951ec8f334" returned: 0 in 0.960s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Lock "cinder-quobyte-8f471268-f84e-4a09-b52c-9a951ec8f334" released by "delete_volume" :: held 2.008s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Created reservations ['701c6f84-c15d-4292-a997-df2c62e2c7bd', '4d2d1cc6-34d6-4df9-8002-35312618f839', '41867546-4129-4df3-ae9b-e813b72cbeee', 'ab6b80a2-229c-4e26-a47d-f41c38bc3791'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:20 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:19:20 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:20 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac 1073741824" returned: 0 in 1.162s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:20 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac Jul 09 15:19:20 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:20 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Deleted volume successfully. Jul 09 15:19:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc53cffe-4671-4ce0-8438-ca81577c8fbf tempest-VolumesCloneNegativeTest-984674636 None] Lock "cinder-8f471268-f84e-4a09-b52c-9a951ec8f334-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:21 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac" returned: 0 in 0.775s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.729s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4374c6c3-7ca7-4ccc-a07f-a1f018ae4d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fde39a-aced-40cd-a4f0-b927c74b0626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Creating offline snapshot e41a93b6-0b21-4456-ba18-33f86160c497 of volume f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:19:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Volume volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac (449fd0e8-aca9-439e-83aa-13b26fb3e0ac): created successfully Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fde39a-aced-40cd-a4f0-b927c74b0626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Flow 'volume_create_manager' (ee89688d-8d50-40d4-8556-ce089bd6cb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a5536f-b2a3-4074-8dcd-483e36febc30]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e3e599c7-4a5f-49ab-a9ab-6be1e1f73dd6 tempest-VolumesActionsTest-997215630 None] Created volume successfully. Jul 09 15:19:21 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 Jul 09 15:19:21 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:22 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" returned: 0 in 0.961s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 2G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:22 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 2G Jul 09 15:19:22 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Acquiring lock "cinder-449fd0e8-aca9-439e-83aa-13b26fb3e0ac-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Lock "cinder-449fd0e8-aca9-439e-83aa-13b26fb3e0ac-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Acquiring lock "cinder-quobyte-449fd0e8-aca9-439e-83aa-13b26fb3e0ac" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Lock "cinder-quobyte-449fd0e8-aca9-439e-83aa-13b26fb3e0ac" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6d6efb-7ac9-4a37-8631-5b3a435b575b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:23 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac Jul 09 15:19:23 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:23 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 2G" returned: 0 in 1.133s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:23 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 Jul 09 15:19:23 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (40e5c61a-f13e-4991-8209-c3dc01cdcc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3199df86-1519-40ef-b8f0-7ac87954ae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3199df86-1519-40ef-b8f0-7ac87954ae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-932986316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64dafae-58ce-4ebf-93f9-ec3c997b3e0d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:24Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e99e59-226e-4f5f-a83b-c32d14ce2f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e99e59-226e-4f5f-a83b-c32d14ce2f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f925a00-4e64-4b2e-8be2-0f2c413c935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f925a00-4e64-4b2e-8be2-0f2c413c935f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f64dafae-58ce-4ebf-93f9-ec3c997b3e0d', 'volume_name': 'volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7099342-b579-4345-a4fc-fbdcd915272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7099342-b579-4345-a4fc-fbdcd915272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a77c91-31b6-4dea-9c23-6ad64c977d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Volume f64dafae-58ce-4ebf-93f9-ec3c997b3e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d', 'volume_size': 1} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:24 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac" returned: 0 in 0.926s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:24 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac Jul 09 15:19:24 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:24 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497" returned: 0 in 0.835s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:24 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 is being set with open permissions: ugo+rw Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:24 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 Jul 09 15:19:24 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:24 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-449fd0e8-aca9-439e-83aa-13b26fb3e0ac" returned: 0 in 0.693s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Lock "cinder-quobyte-449fd0e8-aca9-439e-83aa-13b26fb3e0ac" released by "delete_volume" :: held 1.678s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Created reservations ['46372d14-86b8-4a9d-a5ec-8c01371a3795', 'e4a13010-d4a0-4876-84dc-65a3f066ae93', '37353742-1982-4470-a648-80390db07618', '88597785-bd48-40e7-b8c0-8c58e064d564'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:25 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:19:25 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:25 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497" returned: 0 in 0.796s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:25 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.info Jul 09 15:19:25 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:25 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.986s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:25 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Deleted volume successfully. Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-56fc3265-85a1-4652-b17e-9ba1277543fe tempest-VolumesActionsTest-997215630 None] Lock "cinder-449fd0e8-aca9-439e-83aa-13b26fb3e0ac-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:26 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.info" returned: 0 in 0.857s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:26 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.info is being set with open permissions: ugo+rw Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:26 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.info Jul 09 15:19:26 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:26 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.info" returned: 0 in 0.681s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.429s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.743s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-932986316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64dafae-58ce-4ebf-93f9-ec3c997b3e0d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:24Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Creating volume f64dafae-58ce-4ebf-93f9-ec3c997b3e0d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:26 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:19:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:26 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d 1073741824 Jul 09 15:19:26 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-24a9a24b-eeb1-459f-bb36-1fea0bb8fce6 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Create snapshot completed successfully Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Acquiring lock "cinder-e41a93b6-0b21-4456-ba18-33f86160c497-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "cinder-e41a93b6-0b21-4456-ba18-33f86160c497-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Acquiring lock "cinder-quobyte-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "cinder-quobyte-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Acquiring lock "cinder-quobyte-e41a93b6-0b21-4456-ba18-33f86160c497" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "cinder-quobyte-e41a93b6-0b21-4456-ba18-33f86160c497" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Deleting offline snapshot e41a93b6-0b21-4456-ba18-33f86160c497 of volume f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] snapshot_file for this snap is: volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7323bc2-59f9-4bc2-85ac-5b4cba2ee20b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:27 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 Jul 09 15:19:27 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:27 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d 1073741824" returned: 0 in 1.119s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:28 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d Jul 09 15:19:28 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:28 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497" returned: 0 in 0.877s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[147f2adc-5249-493d-beae-536fe9b5029a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:28 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 Jul 09 15:19:28 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:28 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d" returned: 0 in 0.902s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a77c91-31b6-4dea-9c23-6ad64c977d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dae2fef-d7ab-4416-8477-22b3bcc55170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Volume volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d (f64dafae-58ce-4ebf-93f9-ec3c997b3e0d): created successfully Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dae2fef-d7ab-4416-8477-22b3bcc55170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (40e5c61a-f13e-4991-8209-c3dc01cdcc4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-67cd67a8-7e5b-4c5e-b620-359fa3ce4df4 tempest-VolumesGetTest-1894678544 None] Created volume successfully. Jul 09 15:19:29 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" returned: 0 in 1.088s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:29 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 Jul 09 15:19:29 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (2034d5e2-72ba-4f91-8720-d386fa4ccf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f88c320-a9c7-403e-9613-c6d4b9c4252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f88c320-a9c7-403e-9613-c6d4b9c4252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1642854295',display_name='tempest-VolumesGetTest-Volume-222639976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde6e7b1-d598-464b-91c3-5c90b50e7373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:30Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8c3495-dba0-4dde-b47b-33bc5ea6324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8c3495-dba0-4dde-b47b-33bc5ea6324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80eadc62-42e2-466f-a8e5-7ef633b7683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80eadc62-42e2-466f-a8e5-7ef633b7683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde6e7b1-d598-464b-91c3-5c90b50e7373', 'volume_name': 'volume-dde6e7b1-d598-464b-91c3-5c90b50e7373', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0450187-afd5-4cc7-bb14-7f8534d87186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0450187-afd5-4cc7-bb14-7f8534d87186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f753c86a-79ce-48b9-b1ef-0b59afb577c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Volume dde6e7b1-d598-464b-91c3-5c90b50e7373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde6e7b1-d598-464b-91c3-5c90b50e7373', 'volume_size': 1} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1642854295',display_name='tempest-VolumesGetTest-Volume-222639976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde6e7b1-d598-464b-91c3-5c90b50e7373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:30Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Creating volume dde6e7b1-d598-464b-91c3-5c90b50e7373 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:30 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497" returned: 0 in 0.931s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:30 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373 1073741824 Jul 09 15:19:30 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:30 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497 Jul 09 15:19:30 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:31 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0.e41a93b6-0b21-4456-ba18-33f86160c497" returned: 0 in 0.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "cinder-quobyte-e41a93b6-0b21-4456-ba18-33f86160c497" released by "_delete_snapshot" :: held 3.872s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "cinder-quobyte-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" released by "delete_snapshot" :: held 3.910s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Created reservations ['f11c294c-ed17-495e-a3ab-a62b69302019', '734fd202-afc4-4e73-9cfa-2f34ed11a1f8', '8f8cba25-c76c-403a-8cc0-cad05ea874a4', 'dc5a4aaa-b964-455b-b188-87cd97194765'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Delete snapshot completed successfully. Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1e1f0c25-ea65-463d-a2d1-dcf89d60632f tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "cinder-e41a93b6-0b21-4456-ba18-33f86160c497-delete_snapshot" released by "delete_snapshot" :: held 4.106s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:31 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373 1073741824" returned: 0 in 1.102s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:31 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373 Jul 09 15:19:31 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Acquiring lock "cinder-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "cinder-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Acquiring lock "cinder-quobyte-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "cinder-quobyte-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ff773b-a844-4214-b66f-8f54e7d76f76]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:32 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 Jul 09 15:19:32 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:32 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373" returned: 0 in 0.853s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:19:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f753c86a-79ce-48b9-b1ef-0b59afb577c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde6e7b1-d598-464b-91c3-5c90b50e7373', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53302c05-cf32-4db8-b39c-f0680bf4f5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Volume volume-dde6e7b1-d598-464b-91c3-5c90b50e7373 (dde6e7b1-d598-464b-91c3-5c90b50e7373): created successfully Jul 09 15:19:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53302c05-cf32-4db8-b39c-f0680bf4f5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (2034d5e2-72ba-4f91-8720-d386fa4ccf01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b8e759b8-11a1-429d-976b-6f0ba90285a2 tempest-VolumesGetTest-1894678544 None] Created volume successfully. Jul 09 15:19:32 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" returned: 0 in 0.935s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:32 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0 Jul 09 15:19:32 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-dde6e7b1-d598-464b-91c3-5c90b50e7373-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Lock "cinder-dde6e7b1-d598-464b-91c3-5c90b50e7373-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-quobyte-dde6e7b1-d598-464b-91c3-5c90b50e7373" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-dde6e7b1-d598-464b-91c3-5c90b50e7373" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeea0408-5342-48b6-8ca0-c076261394c8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:33 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" returned: 0 in 1.009s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "cinder-quobyte-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0" released by "delete_volume" :: held 2.060s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Created reservations ['ae4bd442-7a07-4d18-b384-cceef0c09dbc', '2f757dcf-2daf-49a8-9e2a-c44621154e7a', '6d5dd8da-3685-4203-bd19-abc760086e4a', '61d466c4-3830-4c5f-ac0a-571ff0af20b5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:33 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373 Jul 09 15:19:33 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:34 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:19:34 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:34 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373" returned: 0 in 1.106s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:34 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373 Jul 09 15:19:34 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:34 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.955s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:34 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Deleted volume successfully. Jul 09 15:19:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c83c1351-fd97-4a5a-8ecc-531b8a548bb1 tempest-VolumesSnapshotNegativeTestJSON-1691507894 None] Lock "cinder-f3dcf81f-cbff-4a68-ab35-29b6f1976aa0-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:35 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dde6e7b1-d598-464b-91c3-5c90b50e7373" returned: 0 in 0.942s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-dde6e7b1-d598-464b-91c3-5c90b50e7373" released by "delete_volume" :: held 2.120s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:35 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Created reservations ['a21f15c1-d20b-45d1-b3af-0f6f9f9cf8de', '4e5a06cc-032c-4798-b480-28dc7f050f5f', '25529120-eaf4-4bf5-88a0-83dab4821b14', '1db40671-1634-48c8-a224-38822feef630'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:36 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:19:36 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:36 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.873s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:36 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Deleted volume successfully. Jul 09 15:19:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7011e8e3-87de-4123-be3f-77e3bfe1ff5d tempest-VolumesGetTest-1894678544 None] Lock "cinder-dde6e7b1-d598-464b-91c3-5c90b50e7373-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Lock "cinder-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-quobyte-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d65262-b9b7-4e4d-b5a9-0adaef7fc92e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:37 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d Jul 09 15:19:37 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:38 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d" returned: 0 in 1.018s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:38 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d Jul 09 15:19:38 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:39 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d" returned: 0 in 0.871s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d" released by "delete_volume" :: held 1.948s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Created reservations ['007f9fc8-d39b-46e0-9d7b-a8baee4badc4', '04ad2f70-7144-4cf4-82b5-41fff0964c9e', '720542f8-6fb9-4856-befb-7593105b4de1', '179b7957-88c7-45c6-81be-a00517c89c5a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:19:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:39 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:19:39 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:40 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.231s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (d98f7cad-99b3-47dc-823d-872468f9d909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba84bba-eb09-4724-9e9e-e6f5bb73891f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Deleted volume successfully. Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba84bba-eb09-4724-9e9e-e6f5bb73891f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1083518766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fabc2a-9a9c-424f-8c14-91e89abe9a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:41Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfeb0c4-4145-47f4-8daa-53c6ab9b5e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfeb0c4-4145-47f4-8daa-53c6ab9b5e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5e48f6-944d-4a15-b5d3-f51f35c816f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5e48f6-944d-4a15-b5d3-f51f35c816f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52fabc2a-9a9c-424f-8c14-91e89abe9a61', 'volume_name': 'volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca22570-b23c-4dcd-85b8-d682df40614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca22570-b23c-4dcd-85b8-d682df40614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25daabd-505a-4c09-85a5-5b7fb0265c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Volume 52fabc2a-9a9c-424f-8c14-91e89abe9a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61', 'volume_size': 1} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1083518766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fabc2a-9a9c-424f-8c14-91e89abe9a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:41Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Creating volume 52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f9394e85-2d07-42c4-b5fe-ee9b758a3611 tempest-VolumesGetTest-1894678544 None] Lock "cinder-f64dafae-58ce-4ebf-93f9-ec3c997b3e0d-delete_volume" released by "delete_volume" :: held 3.675s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:19:40 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 1073741824 Jul 09 15:19:40 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Flow 'volume_create_manager' (f130d881-e139-4cc2-b5e4-5b8e688a98fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d6bb6a-07ab-4b5e-b633-50083ed6ecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d6bb6a-07ab-4b5e-b633-50083ed6ecdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1700445515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8005f59-902e-4a28-a677-4131fd220d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffaa9678756a4363a67780e93a098d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:42Z,use_quota=True,user_id='12e00a2e5307496fae4d79f395525e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf2aeac-9ed9-40e3-b094-d0f7a7464386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf2aeac-9ed9-40e3-b094-d0f7a7464386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fb0f3f-b54f-4330-bfcb-a4272015c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fb0f3f-b54f-4330-bfcb-a4272015c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8005f59-902e-4a28-a677-4131fd220d3f', 'volume_name': 'volume-b8005f59-902e-4a28-a677-4131fd220d3f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe8b6b0-52b1-45af-b351-da9cc4857533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe8b6b0-52b1-45af-b351-da9cc4857533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d633621-9455-449f-9cfe-9f24bec7ea34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Volume b8005f59-902e-4a28-a677-4131fd220d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8005f59-902e-4a28-a677-4131fd220d3f', 'volume_size': 1} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:41 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 1073741824" returned: 0 in 1.065s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:41 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 Jul 09 15:19:41 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:42 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61" returned: 0 in 0.753s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1700445515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8005f59-902e-4a28-a677-4131fd220d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffaa9678756a4363a67780e93a098d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:42Z,use_quota=True,user_id='12e00a2e5307496fae4d79f395525e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Creating volume b8005f59-902e-4a28-a677-4131fd220d3f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:19:42 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:42 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f 1073741824 Jul 09 15:19:42 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25daabd-505a-4c09-85a5-5b7fb0265c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d35c43f-ea47-4da1-b3c2-7fffa268cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Volume volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 (52fabc2a-9a9c-424f-8c14-91e89abe9a61): created successfully Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d35c43f-ea47-4da1-b3c2-7fffa268cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (d98f7cad-99b3-47dc-823d-872468f9d909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-545ea575-e49c-46ce-8fbb-0b9c565c04b8 tempest-VolumesGetTest-1894678544 None] Created volume successfully. Jul 09 15:19:43 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f 1073741824" returned: 0 in 1.082s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:43 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f Jul 09 15:19:43 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (648b8e11-d053-4e35-8923-4f6817faaa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c564b7-e5a5-4fb1-b029-a0b3a69dd8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c564b7-e5a5-4fb1-b029-a0b3a69dd8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1477634014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858e7485-93ea-48cf-9569-4492fc3095cf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=52fabc2a-9a9c-424f-8c14-91e89abe9a61,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:44Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c5ad1b-2567-412e-baf8-ff072420a353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c5ad1b-2567-412e-baf8-ff072420a353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d97d0b-2634-4ecb-96e0-83fc82cbc796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d97d0b-2634-4ecb-96e0-83fc82cbc796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '858e7485-93ea-48cf-9569-4492fc3095cf', 'volume_name': 'volume-858e7485-93ea-48cf-9569-4492fc3095cf', 'volume_size': 1, 'source_volid': '52fabc2a-9a9c-424f-8c14-91e89abe9a61', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c85e98-dd3c-448b-a9a2-60a24dadacc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c85e98-dd3c-448b-a9a2-60a24dadacc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0243a7e1-2d2a-46c5-8224-f0cf8ebd4613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Volume 858e7485-93ea-48cf-9569-4492fc3095cf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-858e7485-93ea-48cf-9569-4492fc3095cf', 'volume_size': 1, 'source_volid': '52fabc2a-9a9c-424f-8c14-91e89abe9a61', 'source_volstatus': 'available'} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:44 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f" returned: 0 in 1.150s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.268s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:44 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Cloning volume 52fabc2a-9a9c-424f-8c14-91e89abe9a61 to volume 858e7485-93ea-48cf-9569-4492fc3095cf Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d633621-9455-449f-9cfe-9f24bec7ea34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8005f59-902e-4a28-a677-4131fd220d3f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6dea82-5e84-4982-a0f2-c4a780959388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Volume volume-b8005f59-902e-4a28-a677-4131fd220d3f (b8005f59-902e-4a28-a677-4131fd220d3f): created successfully Jul 09 15:19:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6dea82-5e84-4982-a0f2-c4a780959388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Flow 'volume_create_manager' (f130d881-e139-4cc2-b5e4-5b8e688a98fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Creating offline snapshot 80ccedf4-d468-4cd3-b002-2c5752c7e404 of volume 52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:19:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-48810d69-ac08-43b5-9422-3a843d4b09d6 tempest-VolumesListAdminTestJSON-62880436 None] Created volume successfully. Jul 09 15:19:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d496e0-0ed7-4acc-8024-9e7d81f97d8f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:45 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 Jul 09 15:19:45 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:45 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61" returned: 0 in 0.862s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:45 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 1G Jul 09 15:19:45 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Flow 'volume_create_manager' (e7e00569-9740-4f22-a7af-dccda52ebac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b355878a-ee63-4488-b95e-2516cc23f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b355878a-ee63-4488-b95e-2516cc23f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-15073197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619c8713-3fb0-47e8-b6fb-a58d26324bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffaa9678756a4363a67780e93a098d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:47Z,use_quota=True,user_id='12e00a2e5307496fae4d79f395525e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40df60ca-3b1d-4d15-87c6-f52220912622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40df60ca-3b1d-4d15-87c6-f52220912622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b9a648-3f25-4f30-b7d1-190953d752c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b9a648-3f25-4f30-b7d1-190953d752c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619c8713-3fb0-47e8-b6fb-a58d26324bbd', 'volume_name': 'volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756a7e9d-0102-4420-b8a1-d0cbf277a87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756a7e9d-0102-4420-b8a1-d0cbf277a87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e317e0c5-5152-4e64-b8ac-8be3252504db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:19:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Volume 619c8713-3fb0-47e8-b6fb-a58d26324bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd', 'volume_size': 1} Jul 09 15:19:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:47 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 1G" returned: 0 in 1.159s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:47 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 Jul 09 15:19:47 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:47 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:19:47 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:47 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404" returned: 0 in 0.758s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:47 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 is being set with open permissions: ugo+rw Jul 09 15:19:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:47 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 Jul 09 15:19:47 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:48 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.783s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:19:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:19:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:19:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:19:48 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404" returned: 0 in 0.782s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:48 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.info Jul 09 15:19:48 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:49 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.info" returned: 0 in 0.720s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:49 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.info is being set with open permissions: ugo+rw Jul 09 15:19:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:49 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.info Jul 09 15:19:49 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:50 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.info" returned: 0 in 0.657s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-quobyte-858e7485-93ea-48cf-9569-4492fc3095cf" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-858e7485-93ea-48cf-9569-4492fc3095cf" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] snapshot: 80ccedf4-d468-4cd3-b002-2c5752c7e404, volume: 858e7485-93ea-48cf-9569-4492fc3095cf, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6551f7f6-aee4-4ba7-b012-788f24305fb0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:50 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 Jul 09 15:19:50 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:50 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404" returned: 0 in 0.802s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[745a4e16-f44f-45fd-9f61-5d99ce07c16d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:51 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 Jul 09 15:19:51 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:51 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61" returned: 0 in 0.828s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:51 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:19:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:51 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf Jul 09 15:19:51 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:57 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf" returned: 0 in 6.219s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baef6ed-77a7-4248-a5e4-6259bf83387f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:19:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:58 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 Jul 09 15:19:58 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:58 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=103,cinder:INSERT=27,cinder:SELECT=84,cinder:DELETE=9 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:19:58 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=121,cinder:SELECT=79,cinder:DELETE=11,cinder:INSERT=26 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:19:59 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61" returned: 0 in 1.141s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:59 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:19:59 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Converted 1024.00 MB image at 164.63 MB/s Jul 09 15:19:59 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf is being set with open permissions: ugo+rw Jul 09 15:19:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:19:59 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf Jul 09 15:19:59 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:19:59 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 09 15:19:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf" returned: 0 in 0.821s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:19:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-858e7485-93ea-48cf-9569-4492fc3095cf" released by "_copy_volume_from_snapshot" :: held 9.918s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-quobyte-80ccedf4-d468-4cd3-b002-2c5752c7e404" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-80ccedf4-d468-4cd3-b002-2c5752c7e404" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Deleting offline snapshot 80ccedf4-d468-4cd3-b002-2c5752c7e404 of volume 52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:20:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] snapshot_file for this snap is: volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:20:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ce6e2b-b327-4ba1-b03e-0d009d5d588b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:00 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 Jul 09 15:20:00 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:00 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404" returned: 0 in 0.889s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:20:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea62dbc-5e42-434f-9fd1-d026ac6e3c23]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:01 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 Jul 09 15:20:01 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-9be1e1a2-e82a-4145-9d67-1ee4e28f5ba4 req-fdd47f14-9a42-40db-85fc-7b540784a729 tempest-TestMinimumBasicScenario-1727053900 None] Terminate volume connection completed successfully. Jul 09 15:20:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-9be1e1a2-e82a-4145-9d67-1ee4e28f5ba4 req-fdd47f14-9a42-40db-85fc-7b540784a729 tempest-TestMinimumBasicScenario-1727053900 None] Deleting attachment 6bb72180-7a8c-4464-8592-ccd47b780288. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:20:01 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61" returned: 0 in 0.954s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:01 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 Jul 09 15:20:01 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:02 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404" returned: 0 in 0.779s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:02 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404 Jul 09 15:20:02 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Acquiring lock "cinder-ebc62afd-f14a-4151-bb60-a0a4c95cdda1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Lock "cinder-ebc62afd-f14a-4151-bb60-a0a4c95cdda1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Acquiring lock "cinder-quobyte-ebc62afd-f14a-4151-bb60-a0a4c95cdda1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Lock "cinder-quobyte-ebc62afd-f14a-4151-bb60-a0a4c95cdda1" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7142de25-568f-407f-b697-0859badbb79f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:03 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61.80ccedf4-d468-4cd3-b002-2c5752c7e404" returned: 0 in 0.875s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-80ccedf4-d468-4cd3-b002-2c5752c7e404" released by "_delete_snapshot" :: held 3.619s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:03 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 Jul 09 15:20:03 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.724s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.960s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-15073197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619c8713-3fb0-47e8-b6fb-a58d26324bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffaa9678756a4363a67780e93a098d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:19:47Z,use_quota=True,user_id='12e00a2e5307496fae4d79f395525e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Creating volume 619c8713-3fb0-47e8-b6fb-a58d26324bbd {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:03 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0243a7e1-2d2a-46c5-8224-f0cf8ebd4613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858e7485-93ea-48cf-9569-4492fc3095cf', 'volume_size': 1, 'source_volid': '52fabc2a-9a9c-424f-8c14-91e89abe9a61', 'source_volstatus': 'available'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3a1bc0-1c8f-43fc-96d5-c7534d09aeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:03 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd 1073741824 Jul 09 15:20:03 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Volume volume-858e7485-93ea-48cf-9569-4492fc3095cf (858e7485-93ea-48cf-9569-4492fc3095cf): created successfully Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3a1bc0-1c8f-43fc-96d5-c7534d09aeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (648b8e11-d053-4e35-8923-4f6817faaa6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b2775324-d54a-4da1-a02f-d99ce78a74c2 tempest-VolumesGetTest-1894678544 None] Created volume successfully. Jul 09 15:20:04 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1" returned: 0 in 0.927s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:04 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1 Jul 09 15:20:04 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:04 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd 1073741824" returned: 0 in 1.177s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:04 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd Jul 09 15:20:04 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:05 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ebc62afd-f14a-4151-bb60-a0a4c95cdda1" returned: 0 in 1.040s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Lock "cinder-quobyte-ebc62afd-f14a-4151-bb60-a0a4c95cdda1" released by "delete_volume" :: held 2.027s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (5c56cd3b-75cb-4332-a77d-86af9c5167e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e7554e-a9ee-4237-ae1e-652e5570e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Created reservations ['268d3c34-0ea1-4af7-a740-3071e089ed69', '8f326f4b-7ee5-4f2c-be7a-750f5f34d28d', '4a69229e-c805-487e-acb3-ede811b4b77b', '15494f40-362e-43e1-8b64-1c21b40a49d4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e7554e-a9ee-4237-ae1e-652e5570e170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1573306898',display_name='tempest-VolumesGetTest-Volume-1734818767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767d7820-e750-45ee-bda8-c5a045b35d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:06Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ecc0d7-8470-4a5b-b97b-071a10baa34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ecc0d7-8470-4a5b-b97b-071a10baa34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9207fca2-8b84-4fc4-a64c-28027edb4ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9207fca2-8b84-4fc4-a64c-28027edb4ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '767d7820-e750-45ee-bda8-c5a045b35d0c', 'volume_name': 'volume-767d7820-e750-45ee-bda8-c5a045b35d0c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabf5e3e-5822-46c8-9a1b-0b4abd8cd70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabf5e3e-5822-46c8-9a1b-0b4abd8cd70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ab9c45-bc19-4d4a-8528-09e41516cc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Volume 767d7820-e750-45ee-bda8-c5a045b35d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-767d7820-e750-45ee-bda8-c5a045b35d0c', 'volume_size': 1} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:05 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:05 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:06 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd" returned: 0 in 1.132s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] <== create_volume: return (2368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.371s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1573306898',display_name='tempest-VolumesGetTest-Volume-1734818767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767d7820-e750-45ee-bda8-c5a045b35d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:06Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Creating volume 767d7820-e750-45ee-bda8-c5a045b35d0c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:06 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e317e0c5-5152-4e64-b8ac-8be3252504db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:06 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c 1073741824 Jul 09 15:20:06 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb492586-e1d8-4440-b62e-7bef5c9d1b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Volume volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd (619c8713-3fb0-47e8-b6fb-a58d26324bbd): created successfully Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb492586-e1d8-4440-b62e-7bef5c9d1b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Flow 'volume_create_manager' (e7e00569-9740-4f22-a7af-dccda52ebac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f992fb13-8088-46a0-9a37-ae5b77283a00 tempest-VolumesListAdminTestJSON-62880436 None] Created volume successfully. Jul 09 15:20:06 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.822s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Deleted volume successfully. Jul 09 15:20:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-6ce5050f-9b98-4f26-ac41-1237618be7bb tempest-TestMinimumBasicScenario-1727053900 None] Lock "cinder-ebc62afd-f14a-4151-bb60-a0a4c95cdda1-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Flow 'volume_create_manager' (733b41b1-2d89-4934-843a-1c967a2c3d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c3e0a6-d6fc-4277-8818-cfe5563fb0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:07 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c3e0a6-d6fc-4277-8818-cfe5563fb0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1383058786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e633e3f-ba90-474b-9e30-9bb6e7fd957c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffaa9678756a4363a67780e93a098d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:07Z,use_quota=True,user_id='12e00a2e5307496fae4d79f395525e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d37643-4cf1-4828-bc7b-0c8c3086df28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d37643-4cf1-4828-bc7b-0c8c3086df28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec77d24-5886-4786-85fb-924f6746696a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec77d24-5886-4786-85fb-924f6746696a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e633e3f-ba90-474b-9e30-9bb6e7fd957c', 'volume_name': 'volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1ac517-7194-4083-a83e-bc8a11174771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1ac517-7194-4083-a83e-bc8a11174771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8061c494-b68b-40bc-96fe-ae9e4cd40b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Volume 0e633e3f-ba90-474b-9e30-9bb6e7fd957c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c', 'volume_size': 1} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c 1073741824" returned: 0 in 1.509s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:07 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c Jul 09 15:20:07 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:08 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c" returned: 0 in 0.681s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1383058786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e633e3f-ba90-474b-9e30-9bb6e7fd957c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffaa9678756a4363a67780e93a098d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:07Z,use_quota=True,user_id='12e00a2e5307496fae4d79f395525e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Creating volume 0e633e3f-ba90-474b-9e30-9bb6e7fd957c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:08 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ab9c45-bc19-4d4a-8528-09e41516cc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-767d7820-e750-45ee-bda8-c5a045b35d0c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e818b37f-c031-485f-9335-3f38b8b6a99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:08 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c 1073741824 Jul 09 15:20:08 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Volume volume-767d7820-e750-45ee-bda8-c5a045b35d0c (767d7820-e750-45ee-bda8-c5a045b35d0c): created successfully Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e818b37f-c031-485f-9335-3f38b8b6a99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (5c56cd3b-75cb-4332-a77d-86af9c5167e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-523489cb-96be-40d7-8a1f-12fe472817a6 tempest-VolumesGetTest-1894678544 None] Created volume successfully. Jul 09 15:20:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-767d7820-e750-45ee-bda8-c5a045b35d0c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Lock "cinder-767d7820-e750-45ee-bda8-c5a045b35d0c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-quobyte-767d7820-e750-45ee-bda8-c5a045b35d0c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-767d7820-e750-45ee-bda8-c5a045b35d0c" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b84e4-d45b-4696-ae84-484344447e3f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:09 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c Jul 09 15:20:09 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:09 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c 1073741824" returned: 0 in 1.139s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:09 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c Jul 09 15:20:09 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:10 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c" returned: 0 in 1.155s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:10 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c Jul 09 15:20:10 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:10 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c" returned: 0 in 0.952s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8061c494-b68b-40bc-96fe-ae9e4cd40b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd92653-dd0f-4eda-8ded-21638196e473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Volume volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c (0e633e3f-ba90-474b-9e30-9bb6e7fd957c): created successfully Jul 09 15:20:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd92653-dd0f-4eda-8ded-21638196e473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Flow 'volume_create_manager' (733b41b1-2d89-4934-843a-1c967a2c3d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7a9ddeb0-4b19-49b1-b5cf-c5afb4cb3428 tempest-VolumesListAdminTestJSON-62880436 None] Created volume successfully. Jul 09 15:20:11 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-767d7820-e750-45ee-bda8-c5a045b35d0c" returned: 0 in 0.724s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-767d7820-e750-45ee-bda8-c5a045b35d0c" released by "delete_volume" :: held 1.925s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Created reservations ['966345c6-9371-45ae-8b9d-008e360683fb', '3dc0f227-edb6-4c7d-9d9d-158778b4a7fa', 'e796bae2-7f51-4138-bb27-e5b6ad2b6d9c', 'fe552f80-c21b-4991-9c7b-3e6326c34eac'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:11 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:11 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-858e7485-93ea-48cf-9569-4492fc3095cf-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Lock "cinder-858e7485-93ea-48cf-9569-4492fc3095cf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Flow 'volume_create_manager' (11b7486e-6dcc-4d54-8c1d-890a1611c3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b01e33-7afb-4b5f-ac16-640d84ae913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b01e33-7afb-4b5f-ac16-640d84ae913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1170103167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43034816-f9db-4f63-ae7c-73313a6bff94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3588c6c0ded4ed5a276d877e242b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:11Z,use_quota=True,user_id='0291efd66b294df0aa1e3b347e7a52c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2457401-84c6-4e8d-a4d8-4924dd026463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2457401-84c6-4e8d-a4d8-4924dd026463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa7176d-aafd-4bb4-a46d-fab8915a3d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-quobyte-858e7485-93ea-48cf-9569-4492fc3095cf" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-858e7485-93ea-48cf-9569-4492fc3095cf" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d407b82-8f3d-4036-b5cf-534d77a991a9]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:11 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf Jul 09 15:20:11 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa7176d-aafd-4bb4-a46d-fab8915a3d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43034816-f9db-4f63-ae7c-73313a6bff94', 'volume_name': 'volume-43034816-f9db-4f63-ae7c-73313a6bff94', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526573d2-4c8f-4d27-a095-411ade23dca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526573d2-4c8f-4d27-a095-411ade23dca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4522c80a-89b5-4efb-9f06-2a434c142e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Volume 43034816-f9db-4f63-ae7c-73313a6bff94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43034816-f9db-4f63-ae7c-73313a6bff94', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Trying to clone 43034816-f9db-4f63-ae7c-73313a6bff94 from image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:20:12 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.884s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Deleted volume successfully. Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-12c7f1a7-c1ea-46be-91f7-0afe7187eeac tempest-VolumesGetTest-1894678544 None] Lock "cinder-767d7820-e750-45ee-bda8-c5a045b35d0c-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:20:12 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Image download 20.69 MB at 20.69 MB/s Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d490dddc-6194-4068-bcef-816c74764438]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:12 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Flow 'volume_create_manager' (92c80ae7-698a-4f80-bf52-f8c36b05d913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:12 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD Jul 09 15:20:12 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52877773-a7d3-4c4a-a4c9-40b4cebc2500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf" returned: 0 in 0.968s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52877773-a7d3-4c4a-a4c9-40b4cebc2500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10945d59-265b-4549-a153-0ae6c3d35a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246556cb764b432c84ca2edf197a3658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:13Z,use_quota=True,user_id='ffa4a2b1ddce4b59a75b29c24f314d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbe937f-900f-4f81-bcb4-0c9307cd1237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbe937f-900f-4f81-bcb4-0c9307cd1237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd75e26-b3c8-4ba2-88ee-e45a4178fe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:12 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf Jul 09 15:20:12 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd75e26-b3c8-4ba2-88ee-e45a4178fe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10945d59-265b-4549-a153-0ae6c3d35a04', 'volume_name': 'volume-10945d59-265b-4549-a153-0ae6c3d35a04', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5416a8-cc87-434b-b074-6eefdf2e9939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5416a8-cc87-434b-b074-6eefdf2e9939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f7aa6c-c010-40a1-9cd5-ee93327f3cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Volume 10945d59-265b-4549-a153-0ae6c3d35a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10945d59-265b-4549-a153-0ae6c3d35a04', 'volume_size': 1} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10945d59-265b-4549-a153-0ae6c3d35a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246556cb764b432c84ca2edf197a3658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:13Z,use_quota=True,user_id='ffa4a2b1ddce4b59a75b29c24f314d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Creating volume 10945d59-265b-4549-a153-0ae6c3d35a04 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:12 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:12 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04 1073741824 Jul 09 15:20:12 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:13 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Temporary image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 is fetched for user 0291efd66b294df0aa1e3b347e7a52c9. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:20:13 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-858e7485-93ea-48cf-9569-4492fc3095cf" returned: 0 in 0.698s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-858e7485-93ea-48cf-9569-4492fc3095cf" released by "delete_volume" :: held 1.742s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaa1cf7-79d9-4252-979f-7a6fb18a30e8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Created reservations ['509e7b82-a3d7-437b-a7d5-d52d473342c1', '98143562-f87f-4b3d-8b72-bb28e1f23531', '8ab53e4a-a015-4319-8025-572e56426edb', '35218cec-e1af-4bcc-ab7e-9c0dd1172b6b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:13 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD Jul 09 15:20:13 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:13 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:13 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-52fabc2a-9a9c-424f-8c14-91e89abe9a61-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:13 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Lock "cinder-52fabc2a-9a9c-424f-8c14-91e89abe9a61-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04 1073741824" returned: 0 in 1.089s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-quobyte-52fabc2a-9a9c-424f-8c14-91e89abe9a61" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-52fabc2a-9a9c-424f-8c14-91e89abe9a61" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:14 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04 Jul 09 15:20:14 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dc6b20-d96d-44a6-9eb1-00cf893116da]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:14 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 Jul 09 15:20:14 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:14 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.947s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Deleted volume successfully. Jul 09 15:20:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c5073350-713f-4995-acd1-f73a79517d1c tempest-VolumesGetTest-1894678544 None] Lock "cinder-858e7485-93ea-48cf-9569-4492fc3095cf-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:14 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD" returned: 0 in 1.295s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:15 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:15 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04" returned: 0 in 1.093s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1170103167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43034816-f9db-4f63-ae7c-73313a6bff94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3588c6c0ded4ed5a276d877e242b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:11Z,use_quota=True,user_id='0291efd66b294df0aa1e3b347e7a52c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Creating volume 43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61" returned: 0 in 1.030s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:15 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 1073741824 Jul 09 15:20:15 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f7aa6c-c010-40a1-9cd5-ee93327f3cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10945d59-265b-4549-a153-0ae6c3d35a04', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:15 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61 Jul 09 15:20:15 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d3c10e-b3cb-46cb-8cdc-b4c85fe7e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Volume volume-10945d59-265b-4549-a153-0ae6c3d35a04 (10945d59-265b-4549-a153-0ae6c3d35a04): created successfully Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d3c10e-b3cb-46cb-8cdc-b4c85fe7e57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Flow 'volume_create_manager' (92c80ae7-698a-4f80-bf52-f8c36b05d913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-424db8db-6e3e-451c-87ca-579e3cc8a853 tempest-VolumesListAdminTestJSON-109025035 None] Created volume successfully. Jul 09 15:20:15 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-52fabc2a-9a9c-424f-8c14-91e89abe9a61" returned: 0 in 0.721s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-52fabc2a-9a9c-424f-8c14-91e89abe9a61" released by "delete_volume" :: held 1.868s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Created reservations ['3b577bce-7f58-4148-998a-e729e94468e9', 'f8fec4b7-01cf-4b34-bb50-e1ce478e39b9', 'e39c797a-64c9-4e09-ab33-2ed1f80ba61c', '93481647-3229-4616-9edf-e12f1ba0543d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Acquiring lock "cinder-10945d59-265b-4549-a153-0ae6c3d35a04-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:16 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:16 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Lock "cinder-10945d59-265b-4549-a153-0ae6c3d35a04-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:16 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 1073741824" returned: 0 in 1.073s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Acquiring lock "cinder-quobyte-10945d59-265b-4549-a153-0ae6c3d35a04" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Lock "cinder-quobyte-10945d59-265b-4549-a153-0ae6c3d35a04" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eddbe39-aae9-466b-8e4c-752437289d81]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:16 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "cinder-0e633e3f-ba90-474b-9e30-9bb6e7fd957c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:16 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-0e633e3f-ba90-474b-9e30-9bb6e7fd957c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "cinder-quobyte-0e633e3f-ba90-474b-9e30-9bb6e7fd957c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-quobyte-0e633e3f-ba90-474b-9e30-9bb6e7fd957c" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:16 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04 Jul 09 15:20:16 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[618fd371-428e-40db-8c60-2e2162c6aae7]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:16 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c Jul 09 15:20:16 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:17 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.114s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Deleted volume successfully. Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-52c5fae1-79b0-4126-9cdc-59d89fcad0ac tempest-VolumesGetTest-1894678544 None] Lock "cinder-52fabc2a-9a9c-424f-8c14-91e89abe9a61-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:17 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 0 in 1.201s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] <== create_volume: return (2376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.381s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (f467d152-562a-4015-96c0-6186a94aa844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce36bd6-51a4-49eb-8dce-733583e63ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Attempting download of bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}])) to volume 43034816-f9db-4f63-ae7c-73313a6bff94. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce36bd6-51a4-49eb-8dce-733583e63ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1584875059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a90fad-1af3-4c77-87e9-195849986c46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:17Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f7cc2f-7728-40e7-9472-aafd273bc0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f7cc2f-7728-40e7-9472-aafd273bc0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28c782d-e491-4639-84b1-8082f204c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:20:17 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04" returned: 0 in 1.390s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:17 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04 Jul 09 15:20:17 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dfd6e2-3245-41bf-9773-301492aed812]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_mzc_rqyp {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:17 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c" returned: 0 in 1.325s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:17 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c Jul 09 15:20:17 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:17 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_mzc_rqyp Jul 09 15:20:18 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28c782d-e491-4639-84b1-8082f204c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8a90fad-1af3-4c77-87e9-195849986c46', 'volume_name': 'volume-d8a90fad-1af3-4c77-87e9-195849986c46', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a87d0d-9b8d-4574-9d95-c31668c9b7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a87d0d-9b8d-4574-9d95-c31668c9b7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fd4196-8f6e-4eca-a43b-1d0c2d3e735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Volume d8a90fad-1af3-4c77-87e9-195849986c46: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8a90fad-1af3-4c77-87e9-195849986c46', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 15:20:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Trying to clone d8a90fad-1af3-4c77-87e9-195849986c46 from image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:20:18 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:20:18 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Image download 20.69 MB at 20.69 MB/s Jul 09 15:20:18 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-10945d59-265b-4549-a153-0ae6c3d35a04" returned: 0 in 1.153s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Lock "cinder-quobyte-10945d59-265b-4549-a153-0ae6c3d35a04" released by "delete_volume" :: held 2.630s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdea5725-1371-46ba-8817-ab90feb42cdd]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:19 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Created reservations ['2561d13c-40a4-43e5-8dbc-185882eed3f1', 'abfa6ed6-1aac-4f49-b2f4-769cb9fb200b', '8c4b2703-4ad2-48f8-ae26-89b6fb7c8517', '62333c80-1a95-486f-8582-aeb7c0858d35'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e633e3f-ba90-474b-9e30-9bb6e7fd957c" returned: 0 in 1.167s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-quobyte-0e633e3f-ba90-474b-9e30-9bb6e7fd957c" released by "delete_volume" :: held 2.577s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:19 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD Jul 09 15:20:19 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:19 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_mzc_rqyp" returned: 0 in 1.405s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_mzc_rqyp {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Created reservations ['73d52788-36b5-482d-bd0a-ed228eb50425', 'f8bc482a-f013-4eef-b793-caf537ec0016', '4c85de17-98d6-4056-b0f4-466262d975ec', 'a4c0f4e1-654b-4d98-b093-dda96fbf28a6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:19 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:19 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:19 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_mzc_rqyp Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:19 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:19 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:19 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "cinder-619c8713-3fb0-47e8-b6fb-a58d26324bbd-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-619c8713-3fb0-47e8-b6fb-a58d26324bbd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "cinder-quobyte-619c8713-3fb0-47e8-b6fb-a58d26324bbd" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-quobyte-619c8713-3fb0-47e8-b6fb-a58d26324bbd" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:20 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.919s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab4e2e5-8b43-432c-9670-22c9c2fb9408]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Deleted volume successfully. Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b7b3621c-e6f3-4897-bf0c-db5eb061b289 tempest-VolumesListAdminTestJSON-109025035 None] Lock "cinder-10945d59-265b-4549-a153-0ae6c3d35a04-delete_volume" released by "delete_volume" :: held 4.082s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:20 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD" returned: 0 in 1.379s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Temporary image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 is fetched for user b8666e6390cc4e80b7a23d538719ed28. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:20:20 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_mzc_rqyp" returned: 1 in 1.185s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_mzc_rqyp' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[af07e680-d199-4a9a-a2cc-8b0a929b496d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:20 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd Jul 09 15:20:20 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:20 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.096s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a27369-21cd-4535-8a79-48243c2f9d01]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Deleted volume successfully. Jul 09 15:20:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ab5fba62-69da-4325-816f-b831805abb41 tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-0e633e3f-ba90-474b-9e30-9bb6e7fd957c-delete_volume" released by "delete_volume" :: held 4.142s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:20 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD Jul 09 15:20:20 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:20 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD Jul 09 15:20:20 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:21 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd" returned: 0 in 0.966s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:21 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd Jul 09 15:20:21 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:21 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1584875059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a90fad-1af3-4c77-87e9-195849986c46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:17Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Creating volume d8a90fad-1af3-4c77-87e9-195849986c46 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:21 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:21 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD" returned: 0 in 1.033s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 was qcow2, converting to raw {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:21 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 1073741824 Jul 09 15:20:21 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:21 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:20:21 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:21 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-619c8713-3fb0-47e8-b6fb-a58d26324bbd" returned: 0 in 0.772s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-quobyte-619c8713-3fb0-47e8-b6fb-a58d26324bbd" released by "delete_volume" :: held 1.852s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Created reservations ['3e110266-e564-4fae-a905-720368bfbd13', 'f9c748eb-517f-4cc9-970f-bfe9adeffa9f', '72911b5b-7e96-4444-a24d-dcd7e0da6723', '5633635b-3370-45f0-aacc-c4092ac384cc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:22 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:22 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "cinder-b8005f59-902e-4a28-a677-4131fd220d3f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-b8005f59-902e-4a28-a677-4131fd220d3f-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "cinder-quobyte-b8005f59-902e-4a28-a677-4131fd220d3f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-quobyte-b8005f59-902e-4a28-a677-4131fd220d3f" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:22 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 1073741824" returned: 0 in 1.228s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a1873d-f207-4f18-9275-5e0f111597ed]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:22 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 Jul 09 15:20:22 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:22 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f Jul 09 15:20:22 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:23 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.026s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Deleted volume successfully. Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3a52882-a315-4c8a-aee2-6879a04b7050 tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-619c8713-3fb0-47e8-b6fb-a58d26324bbd-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:23 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f" returned: 0 in 0.964s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:23 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f Jul 09 15:20:23 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:23 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46" returned: 0 in 0.972s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] <== create_volume: return (2275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Attempting download of bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}])) to volume d8a90fad-1af3-4c77-87e9-195849986c46. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bccb61-3277-444c-8b8f-3de9ba79140b]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_dyfp2mbh {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:23 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_dyfp2mbh Jul 09 15:20:23 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:24 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 0 in 2.803s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_lbd_tezwdevstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:20:24 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Converted 112.00 MB image at 39.93 MB/s Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:24 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 1G Jul 09 15:20:24 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:24 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b8005f59-902e-4a28-a677-4131fd220d3f" returned: 0 in 0.889s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-quobyte-b8005f59-902e-4a28-a677-4131fd220d3f" released by "delete_volume" :: held 1.926s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Created reservations ['9357d309-f50e-4f64-b053-85134b4b812a', '4ae77c45-0844-4309-824d-cc9e64828fe4', '4ec0980f-840b-4b00-bcf3-e8e34af4f261', '9e086d91-3420-446c-b875-09e55c67dfd1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:24 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_dyfp2mbh" returned: 0 in 0.894s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_dyfp2mbh {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:24 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:24 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:24 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_dyfp2mbh Jul 09 15:20:24 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:25 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 1G" returned: 0 in 0.875s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b073c7b-a993-4869-96e6-71ca6b409675]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:25 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:20:25 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:25 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.782s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:25 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Deleted volume successfully. Jul 09 15:20:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-08e1540c-d1b0-4f9c-a38b-5d23acf0f27e tempest-VolumesListAdminTestJSON-62880436 None] Lock "cinder-b8005f59-902e-4a28-a677-4131fd220d3f-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:25 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_dyfp2mbh" returned: 1 in 0.896s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_dyfp2mbh' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9dd04d-ed7f-4b4e-b4b5-baa34d4e24d0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:25 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD Jul 09 15:20:25 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:26 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 0 in 0.901s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:26 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:20:26 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:26 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:26 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 was qcow2, converting to raw {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:20:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:26 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 Jul 09 15:20:26 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:27 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 1 in 0.977s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Downloaded image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}])) to volume 43034816-f9db-4f63-ae7c-73313a6bff94 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Temporary image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 for user 0291efd66b294df0aa1e3b347e7a52c9 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Marking volume 43034816-f9db-4f63-ae7c-73313a6bff94 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Copying metadata from image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 to 43034816-f9db-4f63-ae7c-73313a6bff94. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Creating volume glance metadata for volume 43034816-f9db-4f63-ae7c-73313a6bff94 backed by image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4522c80a-89b5-4efb-9f06-2a434c142e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43034816-f9db-4f63-ae7c-73313a6bff94', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dfce6ae-c748-4a7c-9e1f-846ddc8ee6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:27 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Volume volume-43034816-f9db-4f63-ae7c-73313a6bff94 (43034816-f9db-4f63-ae7c-73313a6bff94): created successfully Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dfce6ae-c748-4a7c-9e1f-846ddc8ee6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Flow 'volume_create_manager' (11b7486e-6dcc-4d54-8c1d-890a1611c3aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-be390a10-36ad-4446-ad56-11469ab1e9c8 tempest-TestShelveInstance-1036820882 None] Created volume successfully. Jul 09 15:20:28 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46" returned: 0 in 2.506s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:28 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_fxigi19jdevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:20:28 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Converted 112.00 MB image at 44.66 MB/s Jul 09 15:20:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:28 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 1G Jul 09 15:20:28 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:29 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 1G" returned: 0 in 0.958s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[379d5f95-4934-457c-9109-86124e069fd7]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:30 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 Jul 09 15:20:30 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:30 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46" returned: 0 in 0.971s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:31 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 Jul 09 15:20:31 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Flow 'volume_create_manager' (809dd15c-199e-4a74-9bfd-33824685001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e825313-aa72-41a0-8cc0-645de3aa4173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e825313-aa72-41a0-8cc0-645de3aa4173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1280564161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d997d98-a9e0-4757-91eb-7507c51d67f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97da83ec8a04854b4431e6f095e246d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:31Z,use_quota=True,user_id='df91d4b66dbe44e7bd9af7d66d78c790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd59f57-2911-4ef3-b6de-e687a627e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd59f57-2911-4ef3-b6de-e687a627e263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d1b968-acb5-4dc2-95a6-08e8a6fa0aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d1b968-acb5-4dc2-95a6-08e8a6fa0aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d997d98-a9e0-4757-91eb-7507c51d67f0', 'volume_name': 'volume-5d997d98-a9e0-4757-91eb-7507c51d67f0', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78317cf8-03b0-4106-8eb0-89aabfb7c51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78317cf8-03b0-4106-8eb0-89aabfb7c51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588fbd2f-37c6-40ac-9e8f-5e3aa131299a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Volume 5d997d98-a9e0-4757-91eb-7507c51d67f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d997d98-a9e0-4757-91eb-7507c51d67f0', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Trying to clone 5d997d98-a9e0-4757-91eb-7507c51d67f0 from image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:20:31 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46" returned: 1 in 0.946s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Downloaded image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}])) to volume d8a90fad-1af3-4c77-87e9-195849986c46 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Temporary image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 for user b8666e6390cc4e80b7a23d538719ed28 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Marking volume d8a90fad-1af3-4c77-87e9-195849986c46 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Copying metadata from image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 to d8a90fad-1af3-4c77-87e9-195849986c46. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Creating volume glance metadata for volume d8a90fad-1af3-4c77-87e9-195849986c46 backed by image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:20:31 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:20:31 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Image download 20.69 MB at 20.69 MB/s Jul 09 15:20:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf9225e-f38c-4daa-8c08-4c36088f5e32]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fd4196-8f6e-4eca-a43b-1d0c2d3e735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a90fad-1af3-4c77-87e9-195849986c46', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bbc539-9736-49d7-9a51-e8c32e108336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Volume volume-d8a90fad-1af3-4c77-87e9-195849986c46 (d8a90fad-1af3-4c77-87e9-195849986c46): created successfully Jul 09 15:20:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bbc539-9736-49d7-9a51-e8c32e108336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (f467d152-562a-4015-96c0-6186a94aa844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4584e28f-2acf-483b-83db-07229faea1c0 tempest-VolumesGetTest-1894678544 None] Created volume successfully. Jul 09 15:20:32 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD Jul 09 15:20:32 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:32 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD" returned: 0 in 0.899s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:32 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Temporary image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 is fetched for user df91d4b66dbe44e7bd9af7d66d78c790. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b31e00a-fc84-438c-8206-f8bafaa1167e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:33 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD Jul 09 15:20:33 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (0bdc2db1-36ee-4985-a25b-247a5ae87fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5267d1-e6b4-4b02-aa80-20310ee7e6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5267d1-e6b4-4b02-aa80-20310ee7e6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1303138685',display_name='tempest-VolumesGetTest-Volume-1687598079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c923922c-0df5-4ee5-9dae-e78164b80d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:34Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdd60ae-4918-4369-916c-8734b877aa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdd60ae-4918-4369-916c-8734b877aa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad1a91e-b5a3-4c07-9564-4cce22071e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad1a91e-b5a3-4c07-9564-4cce22071e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c923922c-0df5-4ee5-9dae-e78164b80d49', 'volume_name': 'volume-c923922c-0df5-4ee5-9dae-e78164b80d49', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001ae415-15a5-435e-9b7f-f98d855b10c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001ae415-15a5-435e-9b7f-f98d855b10c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602fe78a-7c34-45e6-9306-ffc612257242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Volume c923922c-0df5-4ee5-9dae-e78164b80d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c923922c-0df5-4ee5-9dae-e78164b80d49', 'volume_size': 1} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1303138685',display_name='tempest-VolumesGetTest-Volume-1687598079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c923922c-0df5-4ee5-9dae-e78164b80d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a587cfd32a4f00860b6e4466fdb8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:34Z,use_quota=True,user_id='b8666e6390cc4e80b7a23d538719ed28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Creating volume c923922c-0df5-4ee5-9dae-e78164b80d49 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:33 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:33 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49 1073741824 Jul 09 15:20:33 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:34 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD" returned: 0 in 0.981s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:34 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49 1073741824" returned: 0 in 1.074s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:34 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49 Jul 09 15:20:34 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:35 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49" returned: 0 in 0.771s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.713s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1280564161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d997d98-a9e0-4757-91eb-7507c51d67f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97da83ec8a04854b4431e6f095e246d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:31Z,use_quota=True,user_id='df91d4b66dbe44e7bd9af7d66d78c790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Creating volume 5d997d98-a9e0-4757-91eb-7507c51d67f0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:35 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:35 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 1073741824 Jul 09 15:20:35 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602fe78a-7c34-45e6-9306-ffc612257242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c923922c-0df5-4ee5-9dae-e78164b80d49', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96f9342-4176-4d7a-8772-5bb6c3b5b8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Volume volume-c923922c-0df5-4ee5-9dae-e78164b80d49 (c923922c-0df5-4ee5-9dae-e78164b80d49): created successfully Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96f9342-4176-4d7a-8772-5bb6c3b5b8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Flow 'volume_create_manager' (0bdc2db1-36ee-4985-a25b-247a5ae87fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1f563ded-7112-4feb-ad37-99015331d229 tempest-VolumesGetTest-1894678544 None] Created volume successfully. Jul 09 15:20:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e7e10c64-a56d-4b0f-8cff-90d56f3c25b7 req-801e8a8f-c50d-4569-bf36-5895cdfd0940 tempest-TestShelveInstance-1036820882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:36 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 1073741824" returned: 0 in 1.213s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:37 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 Jul 09 15:20:37 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-c923922c-0df5-4ee5-9dae-e78164b80d49-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Lock "cinder-c923922c-0df5-4ee5-9dae-e78164b80d49-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-quobyte-c923922c-0df5-4ee5-9dae-e78164b80d49" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-c923922c-0df5-4ee5-9dae-e78164b80d49" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdf0736-54bd-49e9-bee2-69b8b784f7dd]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:37 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49 Jul 09 15:20:37 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:37 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0" returned: 0 in 0.864s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e7e10c64-a56d-4b0f-8cff-90d56f3c25b7 req-801e8a8f-c50d-4569-bf36-5895cdfd0940 tempest-TestShelveInstance-1036820882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.562s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Attempting download of bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}])) to volume 5d997d98-a9e0-4757-91eb-7507c51d67f0. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7438ffbf-4c2f-4873-84f5-91b617aab266]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e7e10c64-a56d-4b0f-8cff-90d56f3c25b7 req-801e8a8f-c50d-4569-bf36-5895cdfd0940 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d390cf-ad17-48a2-898c-c924c8b64736]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_b6awu_2n {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:38 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:20:38 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:38 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_b6awu_2n Jul 09 15:20:38 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:38 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49" returned: 0 in 1.038s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:38 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49 Jul 09 15:20:38 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:39 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_b6awu_2n" returned: 0 in 1.163s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_b6awu_2n {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:39 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c923922c-0df5-4ee5-9dae-e78164b80d49" returned: 0 in 0.932s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-c923922c-0df5-4ee5-9dae-e78164b80d49" released by "delete_volume" :: held 2.049s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Created reservations ['f8073f36-c5c4-4150-9357-810447b2bfef', '626d42a6-618a-4409-90e0-b19b657845a8', '9b5e8cf0-1c66-4b30-835b-2f687633598c', '0e11b78b-f14b-4863-9ce0-c7d028944e09'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:39 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_b6awu_2n Jul 09 15:20:39 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:39 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:39 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:39 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e7e10c64-a56d-4b0f-8cff-90d56f3c25b7 req-801e8a8f-c50d-4569-bf36-5895cdfd0940 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 0 in 1.696s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e7e10c64-a56d-4b0f-8cff-90d56f3c25b7 req-801e8a8f-c50d-4569-bf36-5895cdfd0940 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:39 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:20:39 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:40 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_b6awu_2n" returned: 1 in 1.107s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_b6awu_2n' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e374fd-a167-4fdb-86be-90bed55f2682]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:40 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD Jul 09 15:20:40 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-d8a90fad-1af3-4c77-87e9-195849986c46-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Lock "cinder-d8a90fad-1af3-4c77-87e9-195849986c46-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:40 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e7e10c64-a56d-4b0f-8cff-90d56f3c25b7 req-801e8a8f-c50d-4569-bf36-5895cdfd0940 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 1 in 1.109s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-e7e10c64-a56d-4b0f-8cff-90d56f3c25b7 req-801e8a8f-c50d-4569-bf36-5895cdfd0940 tempest-TestShelveInstance-1036820882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-e7e10c64-a56d-4b0f-8cff-90d56f3c25b7 req-801e8a8f-c50d-4569-bf36-5895cdfd0940 tempest-TestShelveInstance-1036820882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.884s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:40 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.348s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Acquiring lock "cinder-quobyte-d8a90fad-1af3-4c77-87e9-195849986c46" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Deleted volume successfully. Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-d8a90fad-1af3-4c77-87e9-195849986c46" acquired by "delete_volume" :: waited 0.052s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fbe6f5b1-7ada-425b-80fe-0e0c4b57ce3d tempest-VolumesGetTest-1894678544 None] Lock "cinder-c923922c-0df5-4ee5-9dae-e78164b80d49-delete_volume" released by "delete_volume" :: held 3.750s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-e7e10c64-a56d-4b0f-8cff-90d56f3c25b7 req-801e8a8f-c50d-4569-bf36-5895cdfd0940 tempest-TestShelveInstance-1036820882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-43034816-f9db-4f63-ae7c-73313a6bff94', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6854f16-79cb-42f4-b6de-e6572b20651a', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ae989f-5d25-460b-a342-701627ef5da7]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-e7e10c64-a56d-4b0f-8cff-90d56f3c25b7 req-801e8a8f-c50d-4569-bf36-5895cdfd0940 tempest-TestShelveInstance-1036820882 None] attachment_update completed successfully. Jul 09 15:20:41 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 Jul 09 15:20:41 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:41 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD" returned: 0 in 1.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:41 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 was qcow2, converting to raw {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:20:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:41 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 Jul 09 15:20:41 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:41 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46" returned: 0 in 0.943s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:42 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 Jul 09 15:20:42 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:42 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46" returned: 1 in 0.905s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:42 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46 Jul 09 15:20:42 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:43 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d8a90fad-1af3-4c77-87e9-195849986c46" returned: 0 in 0.752s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Lock "cinder-quobyte-d8a90fad-1af3-4c77-87e9-195849986c46" released by "delete_volume" :: held 2.702s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Created reservations ['222e4941-ddc2-4d9f-ab9e-84ac1a63002e', '9acf8317-dbcc-4e68-9e9b-6d49055445e4', 'b95966da-18f2-4ef9-9ea7-be6fb3d2f4f6', 'dbf30248-5fd0-4f7a-98ac-ddce7ecddd44'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:43 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:43 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:44 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0" returned: 0 in 2.579s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:44 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bf3f3d0f-c76b-486d-a5be-dad00c5e6db1_f6b8gk_2devstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:20:44 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Converted 112.00 MB image at 43.34 MB/s Jul 09 15:20:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:44 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 1G Jul 09 15:20:44 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:44 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.844s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Deleted volume successfully. Jul 09 15:20:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-97f5dfbc-66bb-4eaf-89a5-1516052816ac tempest-VolumesGetTest-1894678544 None] Lock "cinder-d8a90fad-1af3-4c77-87e9-195849986c46-delete_volume" released by "delete_volume" :: held 3.928s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:45 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 1G" returned: 0 in 1.185s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88b762e-369e-4caa-8ee4-3268b9fa2c10]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:45 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 Jul 09 15:20:45 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:46 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0" returned: 0 in 1.078s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:46 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 Jul 09 15:20:46 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:47 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0" returned: 1 in 1.111s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Downloaded image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}])) to volume 5d997d98-a9e0-4757-91eb-7507c51d67f0 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Temporary image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 for user df91d4b66dbe44e7bd9af7d66d78c790 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Marking volume 5d997d98-a9e0-4757-91eb-7507c51d67f0 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Copying metadata from image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 to 5d997d98-a9e0-4757-91eb-7507c51d67f0. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Creating volume glance metadata for volume 5d997d98-a9e0-4757-91eb-7507c51d67f0 backed by image bf3f3d0f-c76b-486d-a5be-dad00c5e6db1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:47 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:47 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588fbd2f-37c6-40ac-9e8f-5e3aa131299a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d997d98-a9e0-4757-91eb-7507c51d67f0', 'volume_size': 1, 'image_id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a5cd2e57b57f46e5bdcef25b781aefd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf3f3d0f-c76b-486d-a5be-dad00c5e6db1', 'created_at': datetime.datetime(2026, 7, 9, 13, 2, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 2, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf3f3d0f-c76b-486d-a5be-dad00c5e6db1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc5b2c4-d82d-4651-ad36-0f4b4fc5bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Volume volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 (5d997d98-a9e0-4757-91eb-7507c51d67f0): created successfully Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc5b2c4-d82d-4651-ad36-0f4b4fc5bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Flow 'volume_create_manager' (809dd15c-199e-4a74-9bfd-33824685001d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-079a67da-b0b9-4503-b7d6-8b8a6d4a7def tempest-VolumesImageMetadata-1483272674 None] Created volume successfully. Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Flow 'volume_create_manager' (523fed66-3623-4ac6-a0f3-9efa9cbc2ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd87062-fc5a-4877-a204-78fe03767f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd87062-fc5a-4877-a204-78fe03767f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-564072355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41388dc5-8f83-4bcd-b38a-ff3056bedd2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='016e8ead765f4f598ae1cd39406c6426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:48Z,use_quota=True,user_id='449e3f5d1fdf4ce4a5360091f099c013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ca6c45-55f5-4821-9a7d-e5dfc2d94bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ca6c45-55f5-4821-9a7d-e5dfc2d94bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799b48b6-a230-4048-956a-4879774c743b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799b48b6-a230-4048-956a-4879774c743b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41388dc5-8f83-4bcd-b38a-ff3056bedd2e', 'volume_name': 'volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168fa3c7-5675-44ee-8f9b-371796efe1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168fa3c7-5675-44ee-8f9b-371796efe1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128133f3-2fce-4ea7-961d-062b102ce03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Volume 41388dc5-8f83-4bcd-b38a-ff3056bedd2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e', 'volume_size': 1} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-564072355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41388dc5-8f83-4bcd-b38a-ff3056bedd2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='016e8ead765f4f598ae1cd39406c6426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:48Z,use_quota=True,user_id='449e3f5d1fdf4ce4a5360091f099c013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Creating volume 41388dc5-8f83-4bcd-b38a-ff3056bedd2e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:48 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:48 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.854s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:20:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:20:48 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e 1073741824 Jul 09 15:20:48 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Acquiring lock "cinder-5d997d98-a9e0-4757-91eb-7507c51d67f0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Lock "cinder-5d997d98-a9e0-4757-91eb-7507c51d67f0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Acquiring lock "cinder-quobyte-5d997d98-a9e0-4757-91eb-7507c51d67f0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:20:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Lock "cinder-quobyte-5d997d98-a9e0-4757-91eb-7507c51d67f0" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:20:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[18279918-dfe0-40c3-80f9-58671fcc2818]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:20:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:49 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 Jul 09 15:20:49 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:49 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e 1073741824" returned: 0 in 1.210s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:49 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e Jul 09 15:20:49 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:50 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0" returned: 0 in 0.903s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:50 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e" returned: 0 in 0.809s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128133f3-2fce-4ea7-961d-062b102ce03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1219b669-815a-428a-ba6a-ecd5f52ec64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:50 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 Jul 09 15:20:50 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Volume volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e (41388dc5-8f83-4bcd-b38a-ff3056bedd2e): created successfully Jul 09 15:20:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1219b669-815a-428a-ba6a-ecd5f52ec64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Flow 'volume_create_manager' (523fed66-3623-4ac6-a0f3-9efa9cbc2ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-51093644-561c-4309-a94b-93b2bafa61bc tempest-VolumesListTestJSON-2013289347 None] Created volume successfully. Jul 09 15:20:51 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0" returned: 1 in 0.839s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:20:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:51 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0 Jul 09 15:20:51 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:52 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Flow 'volume_create_manager' (f315bb68-6328-4355-8e7d-c1fb5f2a11da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc83706-5d3d-45a8-9431-045e518defc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d997d98-a9e0-4757-91eb-7507c51d67f0" returned: 0 in 1.105s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc83706-5d3d-45a8-9431-045e518defc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1481938405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3d7e7d-b963-45eb-82bd-78020835e7ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='016e8ead765f4f598ae1cd39406c6426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:52Z,use_quota=True,user_id='449e3f5d1fdf4ce4a5360091f099c013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db852c9-5527-4b0b-8cac-39d6fe7d7b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db852c9-5527-4b0b-8cac-39d6fe7d7b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265683cc-9bb1-4585-b48e-e09866ab715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265683cc-9bb1-4585-b48e-e09866ab715d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3d7e7d-b963-45eb-82bd-78020835e7ca', 'volume_name': 'volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa83aa2-7c56-42c6-b0b5-9a228f9c5bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa83aa2-7c56-42c6-b0b5-9a228f9c5bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3000e7-2280-4714-adac-93e4bb3f748d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Volume 4e3d7e7d-b963-45eb-82bd-78020835e7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca', 'volume_size': 1} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1481938405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3d7e7d-b963-45eb-82bd-78020835e7ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='016e8ead765f4f598ae1cd39406c6426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:52Z,use_quota=True,user_id='449e3f5d1fdf4ce4a5360091f099c013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Creating volume 4e3d7e7d-b963-45eb-82bd-78020835e7ca {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:52 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Lock "cinder-quobyte-5d997d98-a9e0-4757-91eb-7507c51d67f0" released by "delete_volume" :: held 3.136s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:52 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca 1073741824 Jul 09 15:20:52 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Created reservations ['d27cee98-1a5f-406a-8115-0eb758635710', 'c1aa4fa7-fee2-48c9-a4a0-9f3ab762d3b3', '57579c30-a7be-472a-b4d4-e1c6a234415c', 'c5a6a059-723f-4f1a-85ab-2375aa9de3b7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:20:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:53 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:20:53 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:54 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.469s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:20:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Deleted volume successfully. Jul 09 15:20:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31249d05-85bb-4de0-8ad3-d33ea2f0fbe5 tempest-VolumesImageMetadata-1483272674 None] Lock "cinder-5d997d98-a9e0-4757-91eb-7507c51d67f0-delete_volume" released by "delete_volume" :: held 5.160s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:20:54 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca 1073741824" returned: 0 in 2.143s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:54 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca Jul 09 15:20:54 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Flow 'volume_create_manager' (305ae3fd-5d26-41cb-aa6a-9b407858e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ae3079-040c-4063-ad18-64d062d8929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ae3079-040c-4063-ad18-64d062d8929e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1009167178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08f6872b88e413686459608e693ad1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:56Z,use_quota=True,user_id='0d0672191aae483ba5929c18b513c2b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799a5bb7-f356-4909-b677-720a3e52fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799a5bb7-f356-4909-b677-720a3e52fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae06ce67-3069-4871-851e-adac0dad4988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae06ce67-3069-4871-851e-adac0dad4988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe', 'volume_name': 'volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1ec94d-819a-4129-9fb9-7c6fe029f15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1ec94d-819a-4129-9fb9-7c6fe029f15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f065177-32a0-4b9a-8364-b200e6e1d628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Volume 5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe', 'volume_size': 1} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:56 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca" returned: 0 in 1.378s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] <== create_volume: return (3598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.605s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1009167178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08f6872b88e413686459608e693ad1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:56Z,use_quota=True,user_id='0d0672191aae483ba5929c18b513c2b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Creating volume 5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:56 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3000e7-2280-4714-adac-93e4bb3f748d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450021a2-0123-4a09-93a4-02b48ccbaf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:56 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe 1073741824 Jul 09 15:20:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Volume volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca (4e3d7e7d-b963-45eb-82bd-78020835e7ca): created successfully Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450021a2-0123-4a09-93a4-02b48ccbaf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:56 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Flow 'volume_create_manager' (f315bb68-6328-4355-8e7d-c1fb5f2a11da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d947a9bf-d34a-4d79-8bed-4e1868b14f6f tempest-VolumesListTestJSON-2013289347 None] Created volume successfully. Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Flow 'volume_create_manager' (7480eea7-07db-4ffa-b899-eb95fc44d4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59eb8de-419a-43f1-8e1a-472d5a43e079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59eb8de-419a-43f1-8e1a-472d5a43e079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2010331664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed749f5-0d33-466e-a34e-d5e410cc07d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08f6872b88e413686459608e693ad1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:57Z,use_quota=True,user_id='0d0672191aae483ba5929c18b513c2b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47c4e63-7752-4c66-99df-1fb8b916efd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47c4e63-7752-4c66-99df-1fb8b916efd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f2378b-15f4-4185-aef6-96bc5e6acab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f2378b-15f4-4185-aef6-96bc5e6acab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed749f5-0d33-466e-a34e-d5e410cc07d8', 'volume_name': 'volume-bed749f5-0d33-466e-a34e-d5e410cc07d8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdbce9f-b017-432d-a6e0-0d3540f3f12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdbce9f-b017-432d-a6e0-0d3540f3f12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ea5139-825b-4669-8512-1e9ee5b461da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Volume bed749f5-0d33-466e-a34e-d5e410cc07d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed749f5-0d33-466e-a34e-d5e410cc07d8', 'volume_size': 1} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:57 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe 1073741824" returned: 0 in 1.558s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:57 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe Jul 09 15:20:57 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Flow 'volume_create_manager' (5f10ae8c-7564-401a-aaa0-f7dd7ef84b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118efa49-b86d-49b4-ab86-c981badb73aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118efa49-b86d-49b4-ab86-c981badb73aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-151352470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e828d944-ff04-435a-91b3-f8a47f6e573e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='016e8ead765f4f598ae1cd39406c6426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:58Z,use_quota=True,user_id='449e3f5d1fdf4ce4a5360091f099c013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4b9cff-52b5-4903-bb78-c5d95798d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4b9cff-52b5-4903-bb78-c5d95798d21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5fb987-df6c-4987-b880-fc7edc85bbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5fb987-df6c-4987-b880-fc7edc85bbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e828d944-ff04-435a-91b3-f8a47f6e573e', 'volume_name': 'volume-e828d944-ff04-435a-91b3-f8a47f6e573e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28416c4a-8021-4032-8f6c-97471e71ea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28416c4a-8021-4032-8f6c-97471e71ea71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f9694c-99f4-4a0d-aeed-d506449443f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Volume e828d944-ff04-435a-91b3-f8a47f6e573e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e828d944-ff04-435a-91b3-f8a47f6e573e', 'volume_size': 1} Jul 09 15:20:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:59 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe" returned: 0 in 1.134s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] <== create_volume: return (2772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.775s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.629s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2010331664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed749f5-0d33-466e-a34e-d5e410cc07d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08f6872b88e413686459608e693ad1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:57Z,use_quota=True,user_id='0d0672191aae483ba5929c18b513c2b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Creating volume bed749f5-0d33-466e-a34e-d5e410cc07d8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:20:59 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=117,cinder:SELECT=123,cinder:INSERT=44,cinder:DELETE=12 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:20:59 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 1073741824 Jul 09 15:20:59 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f065177-32a0-4b9a-8364-b200e6e1d628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971d07e1-c54e-4e47-96a2-21939de30306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=94,cinder:UPDATE=145,cinder:INSERT=51,cinder:DELETE=10 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:20:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Volume volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe (5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe): created successfully Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971d07e1-c54e-4e47-96a2-21939de30306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:20:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Flow 'volume_create_manager' (305ae3fd-5d26-41cb-aa6a-9b407858e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:20:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-32a6d616-af3f-450f-9e0f-862008027877 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Created volume successfully. Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Flow 'volume_create_manager' (8438ff3e-fffd-4470-8060-6dc0afd15cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e34c20-f595-4d27-a1d4-6bfbec4550c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e34c20-f595-4d27-a1d4-6bfbec4550c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-606691137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f260bbd6-3c44-49b8-ad30-ffc2b2c5b357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5d73613334cb4b8d89e7f62a3966b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:00Z,use_quota=True,user_id='e2e01cd53e5744b596af1058ad3bc5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2316d477-0289-411b-9b04-026471b56abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2316d477-0289-411b-9b04-026471b56abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea81c33-8803-4444-badf-1df1ec9993d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea81c33-8803-4444-badf-1df1ec9993d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f260bbd6-3c44-49b8-ad30-ffc2b2c5b357', 'volume_name': 'volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77c47e4-43c5-4099-83ef-b888d8c67e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77c47e4-43c5-4099-83ef-b888d8c67e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530fdb29-755b-4a98-9da6-2fd3b5a74c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Volume f260bbd6-3c44-49b8-ad30-ffc2b2c5b357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357', 'volume_size': 1} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:00 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 1073741824" returned: 0 in 1.786s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:00 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 Jul 09 15:21:00 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:01 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8" returned: 0 in 0.844s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] <== create_volume: return (2706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.712s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.264s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-151352470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e828d944-ff04-435a-91b3-f8a47f6e573e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='016e8ead765f4f598ae1cd39406c6426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:20:58Z,use_quota=True,user_id='449e3f5d1fdf4ce4a5360091f099c013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Creating volume e828d944-ff04-435a-91b3-f8a47f6e573e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:21:01 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ea5139-825b-4669-8512-1e9ee5b461da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed749f5-0d33-466e-a34e-d5e410cc07d8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1aeaad-7362-4375-a739-d04c6d1454f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:01 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e 1073741824 Jul 09 15:21:01 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Volume volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 (bed749f5-0d33-466e-a34e-d5e410cc07d8): created successfully Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1aeaad-7362-4375-a739-d04c6d1454f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Flow 'volume_create_manager' (7480eea7-07db-4ffa-b899-eb95fc44d4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-47e2ee5a-d3d5-4f20-81d3-16ecc4d7726b tempest-TestServerVolumeAttachmentScenario-1649562643 None] Created volume successfully. Jul 09 15:21:03 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e 1073741824" returned: 0 in 1.297s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:03 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e Jul 09 15:21:03 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:03 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e" returned: 0 in 0.705s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.462s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-606691137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f260bbd6-3c44-49b8-ad30-ffc2b2c5b357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af5d73613334cb4b8d89e7f62a3966b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:00Z,use_quota=True,user_id='e2e01cd53e5744b596af1058ad3bc5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Creating volume f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:21:03 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f9694c-99f4-4a0d-aeed-d506449443f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e828d944-ff04-435a-91b3-f8a47f6e573e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406e0ca4-16f4-489c-8d08-bd5c2e56fe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:03 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 1073741824 Jul 09 15:21:03 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Volume volume-e828d944-ff04-435a-91b3-f8a47f6e573e (e828d944-ff04-435a-91b3-f8a47f6e573e): created successfully Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406e0ca4-16f4-489c-8d08-bd5c2e56fe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Flow 'volume_create_manager' (5f10ae8c-7564-401a-aaa0-f7dd7ef84b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b6e2922c-396a-47f7-bdc8-cd92e11d3d4b tempest-VolumesListTestJSON-2013289347 None] Created volume successfully. Jul 09 15:21:04 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 1073741824" returned: 0 in 0.869s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:04 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 Jul 09 15:21:04 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:05 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" returned: 0 in 0.748s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:21:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530fdb29-755b-4a98-9da6-2fd3b5a74c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9e58f1-cd83-452d-a7d6-67156b5ae234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Volume volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 (f260bbd6-3c44-49b8-ad30-ffc2b2c5b357): created successfully Jul 09 15:21:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9e58f1-cd83-452d-a7d6-67156b5ae234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Flow 'volume_create_manager' (8438ff3e-fffd-4470-8060-6dc0afd15cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3fc42fb6-93fc-40eb-924d-842992413f05 tempest-SnapshotMetadataTestJSON-1043632395 None] Created volume successfully. Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "cinder-e828d944-ff04-435a-91b3-f8a47f6e573e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Creating offline snapshot ad3f4745-663e-4a62-aa5d-75fd52f836db of volume f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-e828d944-ff04-435a-91b3-f8a47f6e573e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2150b49-9791-4641-998e-7363fa6c7f6f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "cinder-quobyte-e828d944-ff04-435a-91b3-f8a47f6e573e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-quobyte-e828d944-ff04-435a-91b3-f8a47f6e573e" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b4291f-9a4d-4651-93c5-a7d20f950793]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:07 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 Jul 09 15:21:07 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:07 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e Jul 09 15:21:07 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:08 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" returned: 0 in 1.167s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:08 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db 1G Jul 09 15:21:08 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:08 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e" returned: 0 in 1.226s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:08 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e Jul 09 15:21:08 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:09 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e828d944-ff04-435a-91b3-f8a47f6e573e" returned: 0 in 1.206s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-quobyte-e828d944-ff04-435a-91b3-f8a47f6e573e" released by "delete_volume" :: held 2.503s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Created reservations ['7abf065f-db0f-4a3f-81cd-b0706685d826', '4fc0671e-d6f6-44a9-ad7b-3fe0dd525f06', '4be85a51-a54b-4428-9b2f-44b3a79566c2', '155893af-a161-49d4-ae6d-ab9db69ad008'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:09 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db 1G" returned: 0 in 1.522s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:09 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db Jul 09 15:21:09 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:10 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:21:10 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "cinder-4e3d7e7d-b963-45eb-82bd-78020835e7ca-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-4e3d7e7d-b963-45eb-82bd-78020835e7ca-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "cinder-quobyte-4e3d7e7d-b963-45eb-82bd-78020835e7ca" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-quobyte-4e3d7e7d-b963-45eb-82bd-78020835e7ca" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc3d691-8805-482b-9e83-078e5a97c444]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:10 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db" returned: 0 in 0.892s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:10 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db is being set with open permissions: ugo+rw Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:10 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:10 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.790s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:10 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Deleted volume successfully. Jul 09 15:21:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-92b99709-8b93-4b8e-8063-a0bec4c98d7f tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-e828d944-ff04-435a-91b3-f8a47f6e573e-delete_volume" released by "delete_volume" :: held 3.690s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:10 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca Jul 09 15:21:10 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:11 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db" returned: 0 in 0.702s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:11 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.info Jul 09 15:21:11 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:11 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca" returned: 0 in 0.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:11 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca Jul 09 15:21:11 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:12 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.info" returned: 0 in 0.696s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:12 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.info is being set with open permissions: ugo+rw Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:12 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e3d7e7d-b963-45eb-82bd-78020835e7ca" returned: 0 in 0.669s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:12 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.info Jul 09 15:21:12 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-quobyte-4e3d7e7d-b963-45eb-82bd-78020835e7ca" released by "delete_volume" :: held 1.540s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Created reservations ['8cd6f38d-1f27-484f-897a-29f539c1631c', 'f5f3b469-c74f-46ef-b0eb-f286a0109c14', '9ce02da2-1d98-484e-a861-50405de37026', '8869ae3b-d77e-46f8-ba3b-11d8f67fb9c9'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:12 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:21:12 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "cinder-41388dc5-8f83-4bcd-b38a-ff3056bedd2e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:12 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-41388dc5-8f83-4bcd-b38a-ff3056bedd2e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.info" returned: 0 in 0.722s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.840s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "cinder-quobyte-41388dc5-8f83-4bcd-b38a-ff3056bedd2e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-27d766cb-127e-409e-9ea5-93ee458b7ab6 tempest-SnapshotMetadataTestJSON-1043632395 None] Create snapshot completed successfully Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-quobyte-41388dc5-8f83-4bcd-b38a-ff3056bedd2e" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1d0288-045f-474d-acea-a5953cb9bdbf]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:13 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.742s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:13 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Deleted volume successfully. Jul 09 15:21:13 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e Jul 09 15:21:13 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25658c10-995d-4e30-96fc-0529b03a5a32 tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-4e3d7e7d-b963-45eb-82bd-78020835e7ca-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:14 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e" returned: 0 in 1.154s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:14 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e Jul 09 15:21:14 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Acquiring lock "cinder-ad3f4745-663e-4a62-aa5d-75fd52f836db-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "cinder-ad3f4745-663e-4a62-aa5d-75fd52f836db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Acquiring lock "cinder-quobyte-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "cinder-quobyte-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Acquiring lock "cinder-quobyte-ad3f4745-663e-4a62-aa5d-75fd52f836db" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "cinder-quobyte-ad3f4745-663e-4a62-aa5d-75fd52f836db" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Deleting offline snapshot ad3f4745-663e-4a62-aa5d-75fd52f836db of volume f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] snapshot_file for this snap is: volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb4714-8742-4a3c-a22a-36d7abab8e22]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:14 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db Jul 09 15:21:14 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:14 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-41388dc5-8f83-4bcd-b38a-ff3056bedd2e" returned: 0 in 0.744s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-quobyte-41388dc5-8f83-4bcd-b38a-ff3056bedd2e" released by "delete_volume" :: held 1.955s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Created reservations ['03049368-81a4-4d3a-a719-02f25f7376b0', '34f87546-d961-4cb6-8158-e88fa0d8393f', 'f049a689-0aa9-45bc-b1f3-965104a12da6', '11ff6785-bcfb-49f3-8be8-96ed509adce8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:15 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:21:15 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:15 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db" returned: 0 in 0.858s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:21:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[86da5c2b-ebe7-4e00-9907-8e870fa0b922]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:15 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 Jul 09 15:21:15 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:16 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.043s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:16 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Deleted volume successfully. Jul 09 15:21:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-eacae1d3-81f4-4e4a-9b3e-6b681c916530 tempest-VolumesListTestJSON-2013289347 None] Lock "cinder-41388dc5-8f83-4bcd-b38a-ff3056bedd2e-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:16 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" returned: 0 in 0.984s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:16 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db Jul 09 15:21:16 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:17 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db" returned: 0 in 1.498s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:17 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db Jul 09 15:21:17 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:18 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357.ad3f4745-663e-4a62-aa5d-75fd52f836db" returned: 0 in 0.863s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "cinder-quobyte-ad3f4745-663e-4a62-aa5d-75fd52f836db" released by "_delete_snapshot" :: held 4.370s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "cinder-quobyte-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" released by "delete_snapshot" :: held 4.398s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Created reservations ['8fe35306-f312-428a-946b-89de8b76cd8d', 'af54fb92-24b0-4a30-bf2e-b718b46d4ce6', '69d468f8-3855-4d00-992b-de9662ac417a', 'aa10fbb6-24d1-42ae-a719-e70823af7b1f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Delete snapshot completed successfully. Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3d2d19ef-7dc5-4f44-b20c-3446b842c8d7 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "cinder-ad3f4745-663e-4a62-aa5d-75fd52f836db-delete_snapshot" released by "delete_snapshot" :: held 4.622s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Flow 'volume_create_manager' (4abeaf51-d764-443d-91ee-815b0b5deb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e42523-1b9e-4c17-94e6-e7f44ca3eebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e42523-1b9e-4c17-94e6-e7f44ca3eebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1324473321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd9066b-a87e-43c3-884c-7f9bae0dd09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a7ede397e749579e6e9a83035512c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:19Z,use_quota=True,user_id='74f95473aff04e8db271b15e9a9971b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3276600c-f04f-4d6c-8107-3522df358807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3276600c-f04f-4d6c-8107-3522df358807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a66090-675f-4e6e-aae8-cec570f69a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a66090-675f-4e6e-aae8-cec570f69a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd9066b-a87e-43c3-884c-7f9bae0dd09b', 'volume_name': 'volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801bd2b4-5fca-4ed9-baff-8acf7c2a8adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801bd2b4-5fca-4ed9-baff-8acf7c2a8adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434d8d5a-02e1-4713-8ef6-ef2f1137f157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Volume 2cd9066b-a87e-43c3-884c-7f9bae0dd09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b', 'volume_size': 1} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1324473321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd9066b-a87e-43c3-884c-7f9bae0dd09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a7ede397e749579e6e9a83035512c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:19Z,use_quota=True,user_id='74f95473aff04e8db271b15e9a9971b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Creating volume 2cd9066b-a87e-43c3-884c-7f9bae0dd09b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:21:19 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:19 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b 1073741824 Jul 09 15:21:19 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Acquiring lock "cinder-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "cinder-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Acquiring lock "cinder-quobyte-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "cinder-quobyte-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae40824-1ed7-4dda-b3cf-424591e80081]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:20 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 Jul 09 15:21:20 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:20 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b 1073741824" returned: 0 in 1.313s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:20 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b Jul 09 15:21:20 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:21 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" returned: 0 in 1.235s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:21 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357 Jul 09 15:21:21 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:21 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b" returned: 0 in 0.895s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] <== create_volume: return (2270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:21:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434d8d5a-02e1-4713-8ef6-ef2f1137f157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d3cddb-c730-4321-8d60-a1aa5e590c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Volume volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b (2cd9066b-a87e-43c3-884c-7f9bae0dd09b): created successfully Jul 09 15:21:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d3cddb-c730-4321-8d60-a1aa5e590c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Flow 'volume_create_manager' (4abeaf51-d764-443d-91ee-815b0b5deb7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6a245edf-0aaa-48e0-a89d-970f0705f71b tempest-VolumesNegativeTest-613104115 None] Created volume successfully. Jul 09 15:21:22 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" returned: 0 in 0.792s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "cinder-quobyte-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357" released by "delete_volume" :: held 2.120s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Created reservations ['3897f6d7-d7be-4005-be6a-d6af005938b1', 'e2ef2983-bd65-448a-a1f4-cc10fe391934', 'c8d4e2c3-8c69-4c02-8b38-780cd96bff1d', '748dc398-d7f3-42e7-bd7c-4c3a74c806d6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:22 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:21:22 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:23 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.739s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:23 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Deleted volume successfully. Jul 09 15:21:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ad3ddec5-de4c-42fb-9dc3-468633031293 tempest-SnapshotMetadataTestJSON-1043632395 None] Lock "cinder-f260bbd6-3c44-49b8-ad30-ffc2b2c5b357-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-eee803e0-8a7e-4cc6-b09f-c44e90834b02 req-a64f166c-fad8-48df-a968-a5dacdae9f53 tempest-TestShelveInstance-1036820882 None] Terminate volume connection completed successfully. Jul 09 15:21:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-eee803e0-8a7e-4cc6-b09f-c44e90834b02 req-a64f166c-fad8-48df-a968-a5dacdae9f53 tempest-TestShelveInstance-1036820882 None] Deleting attachment d6854f16-79cb-42f4-b6de-e6572b20651a. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Flow 'volume_create_manager' (ec543835-ef37-4155-b50e-91b52245a9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ed145f-7d86-4ea0-a5e0-348ed6c992d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ed145f-7d86-4ea0-a5e0-348ed6c992d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1560232299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad06b079-e017-47a0-9346-f7941c89e14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42414c1905bd48ecbc61c68d13a64412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:32Z,use_quota=True,user_id='618ed24f3f2242b4b0880dc4db82a654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9dc148-9f63-4e02-9f26-24dd78e91d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9dc148-9f63-4e02-9f26-24dd78e91d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a76bf1-0e2a-42ab-b6df-3c31fe3d2f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a76bf1-0e2a-42ab-b6df-3c31fe3d2f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad06b079-e017-47a0-9346-f7941c89e14a', 'volume_name': 'volume-ad06b079-e017-47a0-9346-f7941c89e14a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be607e6c-2371-4bf5-8775-5c4b24857a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be607e6c-2371-4bf5-8775-5c4b24857a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8cfa92-e97b-44f2-8ea0-eb9cfec48856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Volume ad06b079-e017-47a0-9346-f7941c89e14a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad06b079-e017-47a0-9346-f7941c89e14a', 'volume_size': 1} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1560232299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad06b079-e017-47a0-9346-f7941c89e14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42414c1905bd48ecbc61c68d13a64412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:21:32Z,use_quota=True,user_id='618ed24f3f2242b4b0880dc4db82a654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Creating volume ad06b079-e017-47a0-9346-f7941c89e14a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:21:31 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:21:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:31 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a 1073741824 Jul 09 15:21:31 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:32 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a 1073741824" returned: 0 in 0.853s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:32 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a Jul 09 15:21:32 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:33 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a" returned: 0 in 0.644s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:21:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8cfa92-e97b-44f2-8ea0-eb9cfec48856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad06b079-e017-47a0-9346-f7941c89e14a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d70d47-0491-45b7-8523-a2dd2df674df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:21:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Volume volume-ad06b079-e017-47a0-9346-f7941c89e14a (ad06b079-e017-47a0-9346-f7941c89e14a): created successfully Jul 09 15:21:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d70d47-0491-45b7-8523-a2dd2df674df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:21:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Flow 'volume_create_manager' (ec543835-ef37-4155-b50e-91b52245a9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:21:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d6004f3c-5885-49a4-a88c-bbf12467ffd4 tempest-AbsoluteLimitsTests-176579002 None] Created volume successfully. Jul 09 15:21:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Acquiring lock "cinder-ad06b079-e017-47a0-9346-f7941c89e14a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Lock "cinder-ad06b079-e017-47a0-9346-f7941c89e14a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Acquiring lock "cinder-quobyte-ad06b079-e017-47a0-9346-f7941c89e14a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Lock "cinder-quobyte-ad06b079-e017-47a0-9346-f7941c89e14a" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2f49da-3d7e-487a-9a25-dc5414614429]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:34 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a Jul 09 15:21:34 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-ac8e2206-4718-4dd8-89cc-bb69ab5fbfad req-572b6680-ced1-43a8-af8d-781b265c14f4 tempest-TestShelveInstance-1036820882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-ac8e2206-4718-4dd8-89cc-bb69ab5fbfad req-572b6680-ced1-43a8-af8d-781b265c14f4 tempest-TestShelveInstance-1036820882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f641c8c-6c93-4a50-a278-241eec886167]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-ac8e2206-4718-4dd8-89cc-bb69ab5fbfad req-572b6680-ced1-43a8-af8d-781b265c14f4 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:34 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:21:34 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:35 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a" returned: 0 in 1.026s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:35 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a Jul 09 15:21:35 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:35 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-ac8e2206-4718-4dd8-89cc-bb69ab5fbfad req-572b6680-ced1-43a8-af8d-781b265c14f4 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 0 in 1.145s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-ac8e2206-4718-4dd8-89cc-bb69ab5fbfad req-572b6680-ced1-43a8-af8d-781b265c14f4 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:35 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:21:35 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:36 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ad06b079-e017-47a0-9346-f7941c89e14a" returned: 0 in 0.927s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Lock "cinder-quobyte-ad06b079-e017-47a0-9346-f7941c89e14a" released by "delete_volume" :: held 2.018s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Created reservations ['0cdabaff-4b4e-4a2b-91d2-41723b6fdb9d', '9358f444-c478-4ade-aa78-041fbd30d57f', 'caa5495a-16fb-453d-bd69-22edbc95d8ff', '41756193-85de-4bbe-8f40-d074f4064fed'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:36 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:21:36 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:36 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-ac8e2206-4718-4dd8-89cc-bb69ab5fbfad req-572b6680-ced1-43a8-af8d-781b265c14f4 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 1 in 0.984s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-ac8e2206-4718-4dd8-89cc-bb69ab5fbfad req-572b6680-ced1-43a8-af8d-781b265c14f4 tempest-TestShelveInstance-1036820882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-ac8e2206-4718-4dd8-89cc-bb69ab5fbfad req-572b6680-ced1-43a8-af8d-781b265c14f4 tempest-TestShelveInstance-1036820882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.170s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-ac8e2206-4718-4dd8-89cc-bb69ab5fbfad req-572b6680-ced1-43a8-af8d-781b265c14f4 tempest-TestShelveInstance-1036820882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-43034816-f9db-4f63-ae7c-73313a6bff94', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff478329-8923-47b4-baa1-a3a3f2790f35', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:21:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-ac8e2206-4718-4dd8-89cc-bb69ab5fbfad req-572b6680-ced1-43a8-af8d-781b265c14f4 tempest-TestShelveInstance-1036820882 None] attachment_update completed successfully. Jul 09 15:21:37 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.783s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Deleted volume successfully. Jul 09 15:21:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b80bb6d-aef3-4bbc-9b3d-227a7d48fb44 tempest-AbsoluteLimitsTests-176579002 None] Lock "cinder-ad06b079-e017-47a0-9346-f7941c89e14a-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-92f9f306-3ead-4db5-b614-ea87b6807c1f req-0934978f-e6da-461f-9972-f19f90fbc44c tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-92f9f306-3ead-4db5-b614-ea87b6807c1f req-0934978f-e6da-461f-9972-f19f90fbc44c tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[68202ab5-925f-409e-bda6-507388185f26]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-92f9f306-3ead-4db5-b614-ea87b6807c1f req-0934978f-e6da-461f-9972-f19f90fbc44c tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:44 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe Jul 09 15:21:44 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:45 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-92f9f306-3ead-4db5-b614-ea87b6807c1f req-0934978f-e6da-461f-9972-f19f90fbc44c tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe" returned: 0 in 0.927s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-92f9f306-3ead-4db5-b614-ea87b6807c1f req-0934978f-e6da-461f-9972-f19f90fbc44c tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.951s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-92f9f306-3ead-4db5-b614-ea87b6807c1f req-0934978f-e6da-461f-9972-f19f90fbc44c tempest-TestServerVolumeAttachmentScenario-1649562643 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce7882cc-fb99-4031-8727-53a2a9682f97', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:21:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-92f9f306-3ead-4db5-b614-ea87b6807c1f req-0934978f-e6da-461f-9972-f19f90fbc44c tempest-TestServerVolumeAttachmentScenario-1649562643 None] attachment_update completed successfully. Jul 09 15:21:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:21:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:47 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:21:47 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:48 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.778s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:21:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:21:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:21:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:21:55 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=53,cinder:UPDATE=60,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:21:55 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=69,cinder:DELETE=7,cinder:SELECT=55,cinder:INSERT=16 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:21:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Acquiring lock "cinder-2cd9066b-a87e-43c3-884c-7f9bae0dd09b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Lock "cinder-2cd9066b-a87e-43c3-884c-7f9bae0dd09b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Acquiring lock "cinder-quobyte-2cd9066b-a87e-43c3-884c-7f9bae0dd09b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:21:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Lock "cinder-quobyte-2cd9066b-a87e-43c3-884c-7f9bae0dd09b" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:21:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a7bffd-6598-4453-b8d3-6ccb8af91bab]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:57 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b Jul 09 15:21:57 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:58 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b" returned: 0 in 1.200s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:58 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b Jul 09 15:21:58 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:58 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 09 15:21:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2cd9066b-a87e-43c3-884c-7f9bae0dd09b" returned: 0 in 0.803s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:21:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Lock "cinder-quobyte-2cd9066b-a87e-43c3-884c-7f9bae0dd09b" released by "delete_volume" :: held 2.058s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:21:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Created reservations ['fc7e3734-f42d-47ae-bf0b-2621ed6bcbe4', '742368e2-ed8b-4af6-ac8c-ebfba70944d9', 'c1286123-e4d7-4116-b471-84328132994c', 'cf369965-69ec-4509-8351-cc1e3790baf0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:21:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-b53cec71-e905-46fe-af8a-59a9a0701fcd req-3ebbf242-9c82-41cb-a19d-369776aeee63 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-b53cec71-e905-46fe-af8a-59a9a0701fcd req-3ebbf242-9c82-41cb-a19d-369776aeee63 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b69dc8-4373-450b-ae19-a51e8fe5cde2]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:21:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b53cec71-e905-46fe-af8a-59a9a0701fcd req-3ebbf242-9c82-41cb-a19d-369776aeee63 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:21:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:21:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:21:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:21:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:21:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:21:59 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 Jul 09 15:21:59 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:21:59 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:21:59 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:00 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b53cec71-e905-46fe-af8a-59a9a0701fcd req-3ebbf242-9c82-41cb-a19d-369776aeee63 tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8" returned: 0 in 1.076s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-b53cec71-e905-46fe-af8a-59a9a0701fcd req-3ebbf242-9c82-41cb-a19d-369776aeee63 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.101s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-b53cec71-e905-46fe-af8a-59a9a0701fcd req-3ebbf242-9c82-41cb-a19d-369776aeee63 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-bed749f5-0d33-466e-a34e-d5e410cc07d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e99024cb-c6fb-4932-a110-dd31843bf165', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:22:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-b53cec71-e905-46fe-af8a-59a9a0701fcd req-3ebbf242-9c82-41cb-a19d-369776aeee63 tempest-TestServerVolumeAttachmentScenario-1649562643 None] attachment_update completed successfully. Jul 09 15:22:00 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.410s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:00 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Deleted volume successfully. Jul 09 15:22:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-523ede91-cacd-42de-b0e8-9d09f87740fa tempest-VolumesNegativeTest-613104115 None] Lock "cinder-2cd9066b-a87e-43c3-884c-7f9bae0dd09b-delete_volume" released by "delete_volume" :: held 3.860s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-e9e0264e-e6a7-4ffc-b817-6d0c3b5c90dc req-21a9cbd0-ef51-45a1-a490-1596030eca91 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Terminate volume connection completed successfully. Jul 09 15:22:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-e9e0264e-e6a7-4ffc-b817-6d0c3b5c90dc req-21a9cbd0-ef51-45a1-a490-1596030eca91 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Deleting attachment e99024cb-c6fb-4932-a110-dd31843bf165. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:22:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-13007ff4-d95c-42fe-8e94-1bdf2a9fcb80 req-7a5c5ca3-e6a9-40d9-863d-eb8ce64f88e6 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Terminate volume connection completed successfully. Jul 09 15:22:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-13007ff4-d95c-42fe-8e94-1bdf2a9fcb80 req-7a5c5ca3-e6a9-40d9-863d-eb8ce64f88e6 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Deleting attachment ce7882cc-fb99-4031-8727-53a2a9682f97. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Flow 'volume_create_manager' (4f295b06-bcda-4124-beaf-372120e5feb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b36be73-ecf8-4e96-b50b-082f9b325208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b36be73-ecf8-4e96-b50b-082f9b325208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-97392643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e53574-60b4-4070-82e0-ab791e100804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0cd826f8548ccb768699030f0bc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:18Z,use_quota=True,user_id='ee008504b96042369161ba4e78bd2a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae95d0bd-f9da-4a44-8395-2aecf1e258bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae95d0bd-f9da-4a44-8395-2aecf1e258bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123cfdba-2dff-49dc-8967-374028b9699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123cfdba-2dff-49dc-8967-374028b9699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e53574-60b4-4070-82e0-ab791e100804', 'volume_name': 'volume-00e53574-60b4-4070-82e0-ab791e100804', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017d3bc1-b595-4baf-8f68-f3c6de98efad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017d3bc1-b595-4baf-8f68-f3c6de98efad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8b0005-9bfa-495f-8698-28cad9d9bc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Volume 00e53574-60b4-4070-82e0-ab791e100804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e53574-60b4-4070-82e0-ab791e100804', 'volume_size': 1} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-97392643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e53574-60b4-4070-82e0-ab791e100804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0cd826f8548ccb768699030f0bc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:18Z,use_quota=True,user_id='ee008504b96042369161ba4e78bd2a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Creating volume 00e53574-60b4-4070-82e0-ab791e100804 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:18 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:22:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:18 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 1073741824 Jul 09 15:22:18 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:19 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 1073741824" returned: 0 in 0.898s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:19 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 Jul 09 15:22:19 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:19 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804" returned: 0 in 0.661s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8b0005-9bfa-495f-8698-28cad9d9bc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e53574-60b4-4070-82e0-ab791e100804', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933f3505-a461-4f5e-8279-d8d2929c4f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Volume volume-00e53574-60b4-4070-82e0-ab791e100804 (00e53574-60b4-4070-82e0-ab791e100804): created successfully Jul 09 15:22:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933f3505-a461-4f5e-8279-d8d2929c4f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Flow 'volume_create_manager' (4f295b06-bcda-4124-beaf-372120e5feb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-489d2152-ae18-44b0-9716-e4f965dba013 tempest-VolumesSnapshotTestJSON-377089321 None] Created volume successfully. Jul 09 15:22:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Creating offline snapshot 0d65c17c-aa09-4311-8d7b-216951a2e1eb of volume 00e53574-60b4-4070-82e0-ab791e100804 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:22:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e6910e-78f4-42bb-8828-cab6c36fd950]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:20 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 Jul 09 15:22:20 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "cinder-bed749f5-0d33-466e-a34e-d5e410cc07d8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "cinder-bed749f5-0d33-466e-a34e-d5e410cc07d8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "cinder-quobyte-bed749f5-0d33-466e-a34e-d5e410cc07d8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "cinder-quobyte-bed749f5-0d33-466e-a34e-d5e410cc07d8" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[453d1b1d-4617-471a-9f23-9a06e8e6de05]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:21 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 Jul 09 15:22:21 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:21 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804" returned: 0 in 0.818s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:21 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb 1G Jul 09 15:22:21 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:22 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8" returned: 0 in 0.832s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:22 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8 Jul 09 15:22:22 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:22 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb 1G" returned: 0 in 0.904s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e53574-60b4-4070-82e0-ab791e100804 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:22 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e53574-60b4-4070-82e0-ab791e100804 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb Jul 09 15:22:22 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:22 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-bed749f5-0d33-466e-a34e-d5e410cc07d8" returned: 0 in 0.795s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "cinder-quobyte-bed749f5-0d33-466e-a34e-d5e410cc07d8" released by "delete_volume" :: held 1.677s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Created reservations ['7e98c6e6-e7e3-4f43-a836-3d24c5717860', '54c22f23-ece9-4f0b-b402-4dc19d3a6df6', '84dabd0e-f922-4039-9e0e-5ccb85c75643', 'a0ff3312-1117-4193-a40a-aa134396022c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:23 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:22:23 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:23 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e53574-60b4-4070-82e0-ab791e100804 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb" returned: 0 in 0.929s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:23 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb is being set with open permissions: ugo+rw Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:23 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb Jul 09 15:22:23 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "cinder-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "cinder-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "cinder-quobyte-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "cinder-quobyte-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c7b860-6cc1-4428-85d9-baeba5357dc1]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:23 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe Jul 09 15:22:23 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:24 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.960s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:24 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:24 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Deleted volume successfully. Jul 09 15:22:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b7951c9-6667-4f9e-9ce5-96ce7dd63175 tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "cinder-bed749f5-0d33-466e-a34e-d5e410cc07d8-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:24 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb" returned: 0 in 0.972s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:24 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.info Jul 09 15:22:24 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:24 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe" returned: 0 in 0.978s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:24 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe Jul 09 15:22:24 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:25 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.info" returned: 0 in 0.770s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:25 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.info is being set with open permissions: ugo+rw Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:25 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.info Jul 09 15:22:25 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:25 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe" returned: 0 in 0.702s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "cinder-quobyte-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe" released by "delete_volume" :: held 1.747s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Created reservations ['f4df822c-9f98-4939-8902-ea4e208e05d4', 'ddf7f3e3-b507-4e22-94fb-65b3343b4d32', '31ac1c6d-bf0b-44fe-a175-65e802021ddb', '745c7e88-0c93-42aa-a78e-6b3223401e89'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:25 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:22:25 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:25 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.info" returned: 0 in 0.770s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.269s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3b0285f4-d180-4158-adca-b6035832bba4 tempest-VolumesSnapshotTestJSON-377089321 None] Create snapshot completed successfully Jul 09 15:22:26 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.705s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Deleted volume successfully. Jul 09 15:22:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a31627d8-74a2-4f1b-b05e-113e6e8b1d8e tempest-TestServerVolumeAttachmentScenario-1649562643 None] Lock "cinder-5f3c48bd-2e82-47fe-8a7f-dc7aebbdfabe-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-0d65c17c-aa09-4311-8d7b-216951a2e1eb-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-0d65c17c-aa09-4311-8d7b-216951a2e1eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-00e53574-60b4-4070-82e0-ab791e100804" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-00e53574-60b4-4070-82e0-ab791e100804" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-0d65c17c-aa09-4311-8d7b-216951a2e1eb" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-0d65c17c-aa09-4311-8d7b-216951a2e1eb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Deleting offline snapshot 0d65c17c-aa09-4311-8d7b-216951a2e1eb of volume 00e53574-60b4-4070-82e0-ab791e100804 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:22:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] snapshot_file for this snap is: volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:22:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9b034d-52f7-444d-893a-047189a947da]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:27 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb Jul 09 15:22:27 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:28 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb" returned: 0 in 1.169s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e53574-60b4-4070-82e0-ab791e100804(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:22:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa66d6a-19b9-4eda-96a1-1ba938b6d978]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:28 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 Jul 09 15:22:28 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:29 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804" returned: 0 in 1.120s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:29 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb Jul 09 15:22:29 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:30 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb" returned: 0 in 1.281s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:30 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb Jul 09 15:22:30 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:31 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804.0d65c17c-aa09-4311-8d7b-216951a2e1eb" returned: 0 in 1.011s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-0d65c17c-aa09-4311-8d7b-216951a2e1eb" released by "_delete_snapshot" :: held 4.781s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-00e53574-60b4-4070-82e0-ab791e100804" released by "delete_snapshot" :: held 4.812s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:32 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Created reservations ['04b39041-0a45-42e0-8b2a-f82076efbadf', '5d8d427b-db30-46e0-9048-2aca74b271f3', '7d0f1946-a650-4992-ac0d-f4aa9ef320c5', 'd23c218e-7e80-493c-90e6-7ad5e6430dd6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Delete snapshot completed successfully. Jul 09 15:22:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-89727c06-e885-4886-8cfe-f0362fd30b58 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-0d65c17c-aa09-4311-8d7b-216951a2e1eb-delete_snapshot" released by "delete_snapshot" :: held 5.020s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-58ffad5a-d2a5-4973-9e62-7158afc9ecc4 tempest-TestShelveInstance-1036820882 None] Terminate volume connection completed successfully. Jul 09 15:22:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-58ffad5a-d2a5-4973-9e62-7158afc9ecc4 tempest-TestShelveInstance-1036820882 None] Deleting attachment ff478329-8923-47b4-baa1-a3a3f2790f35. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Acquiring lock "cinder-43034816-f9db-4f63-ae7c-73313a6bff94-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Lock "cinder-43034816-f9db-4f63-ae7c-73313a6bff94-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Acquiring lock "cinder-quobyte-43034816-f9db-4f63-ae7c-73313a6bff94" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Flow 'volume_create_manager' (977e866b-0845-429c-b3d4-b9c6b15acf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cfb651-3d0c-4ea4-9c00-cde2767c33f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Lock "cinder-quobyte-43034816-f9db-4f63-ae7c-73313a6bff94" acquired by "delete_volume" :: waited 0.123s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cfb651-3d0c-4ea4-9c00-cde2767c33f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1181612919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bde5185-1bc5-4461-8285-dad6e4b5c078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0cd826f8548ccb768699030f0bc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:33Z,use_quota=True,user_id='ee008504b96042369161ba4e78bd2a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc48f81-86e7-4a96-9703-03e82e93fe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc48f81-86e7-4a96-9703-03e82e93fe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a9c5d0-579c-4155-b4b8-107ba2346198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a9c5d0-579c-4155-b4b8-107ba2346198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bde5185-1bc5-4461-8285-dad6e4b5c078', 'volume_name': 'volume-1bde5185-1bc5-4461-8285-dad6e4b5c078', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23500e31-483f-4811-bf75-8ca7aa4a5ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23500e31-483f-4811-bf75-8ca7aa4a5ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba3a51c-9299-4d8d-b67f-1a6b6b442509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Volume 1bde5185-1bc5-4461-8285-dad6e4b5c078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bde5185-1bc5-4461-8285-dad6e4b5c078', 'volume_size': 1} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1181612919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bde5185-1bc5-4461-8285-dad6e4b5c078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0cd826f8548ccb768699030f0bc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:33Z,use_quota=True,user_id='ee008504b96042369161ba4e78bd2a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Creating volume 1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:33 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bef409b-aefe-4ec1-9b4f-124e63331af9]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:33 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 1073741824 Jul 09 15:22:33 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:34 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:22:34 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:34 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 0 in 1.154s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:35 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:22:35 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:35 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 1073741824" returned: 0 in 1.490s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:35 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 Jul 09 15:22:35 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:36 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 1 in 1.379s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:22:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:36 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94 Jul 09 15:22:36 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:36 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078" returned: 0 in 1.178s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] <== create_volume: return (2772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.782s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba3a51c-9299-4d8d-b67f-1a6b6b442509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bde5185-1bc5-4461-8285-dad6e4b5c078', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b43f6a-ee04-4e98-8971-201c67651b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Volume volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 (1bde5185-1bc5-4461-8285-dad6e4b5c078): created successfully Jul 09 15:22:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b43f6a-ee04-4e98-8971-201c67651b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Flow 'volume_create_manager' (977e866b-0845-429c-b3d4-b9c6b15acf70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c856c06d-f1e6-45a2-883f-d331218a4212 tempest-VolumesSnapshotTestJSON-377089321 None] Created volume successfully. Jul 09 15:22:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Creating offline snapshot 659a935a-d17d-4de6-ab1e-72bb38659334 of volume 1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:22:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[767ecd74-7df8-4efb-863d-796585d32296]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:37 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 Jul 09 15:22:37 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:37 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-43034816-f9db-4f63-ae7c-73313a6bff94" returned: 0 in 1.505s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Lock "cinder-quobyte-43034816-f9db-4f63-ae7c-73313a6bff94" released by "delete_volume" :: held 4.200s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:37 devstack cinder-volume[86916]: DEBUG cinder.quota [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Created reservations ['24324df7-a01d-4330-ba33-aeb19cb22119', '69a7cde0-6a38-4982-92f1-d4da3a693afa', '476c360c-a548-436f-9764-6b28945a310e', 'b17355b4-1a62-499d-87a3-eb7a69f26227'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:38 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:22:38 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:38 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078" returned: 0 in 1.551s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:38 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 1G Jul 09 15:22:38 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:39 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.931s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:39 devstack cinder-volume[86916]: DEBUG cinder.manager [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Deleted volume successfully. Jul 09 15:22:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [req-7c49337b-4a0b-42f1-a641-3bca47646a17 req-e81cef08-7779-430a-9b01-359ee6b2e873 tempest-TestShelveInstance-1036820882 None] Lock "cinder-43034816-f9db-4f63-ae7c-73313a6bff94-delete_volume" released by "delete_volume" :: held 5.658s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:40 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 1G" returned: 0 in 1.301s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:40 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 Jul 09 15:22:40 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:41 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334" returned: 0 in 0.923s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:41 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 is being set with open permissions: ugo+rw Jul 09 15:22:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:41 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 Jul 09 15:22:41 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:41 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334" returned: 0 in 0.912s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:42 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.info Jul 09 15:22:42 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:42 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.info" returned: 0 in 0.914s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:42 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.info is being set with open permissions: ugo+rw Jul 09 15:22:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:42 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.info Jul 09 15:22:42 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:43 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.info" returned: 0 in 1.081s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.824s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-66cf58c6-df15-4049-8d70-4cdbb6338b25 tempest-VolumesSnapshotTestJSON-377089321 None] Create snapshot completed successfully Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Flow 'volume_create_manager' (9080a179-4ef2-4807-a24e-b97b2c7eda92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9eecad-ddb9-4fa9-8f84-28401d0eb949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9eecad-ddb9-4fa9-8f84-28401d0eb949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1293537549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c16efeec-b072-41ca-a1f7-dfdc4401f105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0cd826f8548ccb768699030f0bc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=659a935a-d17d-4de6-ab1e-72bb38659334,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:45Z,use_quota=True,user_id='ee008504b96042369161ba4e78bd2a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c821a3-b5bc-4d7f-aadd-92463dfd59a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c821a3-b5bc-4d7f-aadd-92463dfd59a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61c7af1-be89-400c-9535-1da89c45e1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61c7af1-be89-400c-9535-1da89c45e1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c16efeec-b072-41ca-a1f7-dfdc4401f105', 'volume_name': 'volume-c16efeec-b072-41ca-a1f7-dfdc4401f105', 'volume_size': 2, 'snapshot_id': '659a935a-d17d-4de6-ab1e-72bb38659334'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7e651d-46e2-4933-b957-aae916e9ced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7e651d-46e2-4933-b957-aae916e9ced3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93efe4d5-11f6-4a10-9e6f-8e0240d1cea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Volume c16efeec-b072-41ca-a1f7-dfdc4401f105: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c16efeec-b072-41ca-a1f7-dfdc4401f105', 'volume_size': 2, 'snapshot_id': '659a935a-d17d-4de6-ab1e-72bb38659334'} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-659a935a-d17d-4de6-ab1e-72bb38659334-c16efeec-b072-41ca-a1f7-dfdc4401f105" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-659a935a-d17d-4de6-ab1e-72bb38659334-c16efeec-b072-41ca-a1f7-dfdc4401f105" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Creating volume c16efeec-b072-41ca-a1f7-dfdc4401f105 from snapshot 659a935a-d17d-4de6-ab1e-72bb38659334 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-c16efeec-b072-41ca-a1f7-dfdc4401f105" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-c16efeec-b072-41ca-a1f7-dfdc4401f105" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] snapshot: 659a935a-d17d-4de6-ab1e-72bb38659334, volume: c16efeec-b072-41ca-a1f7-dfdc4401f105, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e91a560-62a9-49e4-8e0b-e619bbc017fb]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:45 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 Jul 09 15:22:45 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:46 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334" returned: 0 in 0.845s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bde5185-1bc5-4461-8285-dad6e4b5c078(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:22:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:22:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:22:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06ff49e-6a89-47b4-a926-147c76f7f879]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:46 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 Jul 09 15:22:46 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:47 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078" returned: 0 in 0.897s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:47 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:22:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:47 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 Jul 09 15:22:47 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:22:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:47 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:22:47 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:48 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.829s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:22:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:22:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:22:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:22:54 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105" returned: 0 in 6.901s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c3055-77d0-4464-87d1-5f59db0ef2e2]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:54 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 Jul 09 15:22:54 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:55 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078" returned: 0 in 1.236s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:55 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:22:55 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Converted 1024.00 MB image at 148.35 MB/s Jul 09 15:22:55 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 is being set with open permissions: ugo+rw Jul 09 15:22:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:55 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 Jul 09 15:22:55 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:55 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=58,cinder:INSERT=14,cinder:UPDATE=52,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:22:55 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=50,cinder:UPDATE=48,cinder:INSERT=10,cinder:DELETE=6 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:22:55 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Flow 'volume_create_manager' (1d8341a3-3305-4f2b-8418-15ea3569ab0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363eddac-8099-4f4d-a2bf-5a7db525a6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363eddac-8099-4f4d-a2bf-5a7db525a6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-150024393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f119ba-b9fd-4074-b228-f6105b12cea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d2583e94f446a9adb18cf4f69eabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:56Z,use_quota=True,user_id='6bccc2628685481ebfe14b7c52576199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c1db39-d120-4ac6-b01c-1efa63b41c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c1db39-d120-4ac6-b01c-1efa63b41c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09347dd-9e17-4c5f-8ba7-3163857e1f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09347dd-9e17-4c5f-8ba7-3163857e1f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f119ba-b9fd-4074-b228-f6105b12cea2', 'volume_name': 'volume-53f119ba-b9fd-4074-b228-f6105b12cea2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ea0a44-2320-4b73-8a8d-f8c4be3a6874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ea0a44-2320-4b73-8a8d-f8c4be3a6874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5247035b-9725-4cc9-959b-79c25d881421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Volume 53f119ba-b9fd-4074-b228-f6105b12cea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f119ba-b9fd-4074-b228-f6105b12cea2', 'volume_size': 1} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:56 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105" returned: 0 in 0.753s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-c16efeec-b072-41ca-a1f7-dfdc4401f105" released by "_copy_volume_from_snapshot" :: held 10.757s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-659a935a-d17d-4de6-ab1e-72bb38659334-c16efeec-b072-41ca-a1f7-dfdc4401f105" released by "_create_volume_from_snapshot" :: held 10.796s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.824s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.168s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-150024393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f119ba-b9fd-4074-b228-f6105b12cea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d2583e94f446a9adb18cf4f69eabe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:56Z,use_quota=True,user_id='6bccc2628685481ebfe14b7c52576199',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Creating volume 53f119ba-b9fd-4074-b228-f6105b12cea2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:22:56 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:56 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 1073741824 Jul 09 15:22:56 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93efe4d5-11f6-4a10-9e6f-8e0240d1cea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c16efeec-b072-41ca-a1f7-dfdc4401f105', 'volume_size': 2, 'snapshot_id': '659a935a-d17d-4de6-ab1e-72bb38659334'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78dcc91-375b-4e14-8ddf-272c9dc8894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Volume volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 (c16efeec-b072-41ca-a1f7-dfdc4401f105): created successfully Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78dcc91-375b-4e14-8ddf-272c9dc8894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Flow 'volume_create_manager' (9080a179-4ef2-4807-a24e-b97b2c7eda92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-32d7b15b-0bfa-4c59-9777-a4f10fa689aa tempest-VolumesSnapshotTestJSON-377089321 None] Created volume successfully. Jul 09 15:22:57 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 1073741824" returned: 0 in 0.993s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:57 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 Jul 09 15:22:57 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-c16efeec-b072-41ca-a1f7-dfdc4401f105-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-c16efeec-b072-41ca-a1f7-dfdc4401f105-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-c16efeec-b072-41ca-a1f7-dfdc4401f105" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:22:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-c16efeec-b072-41ca-a1f7-dfdc4401f105" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:22:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cf1c1b-c6ae-461e-9164-91cb40354c23]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:57 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 Jul 09 15:22:57 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:58 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2" returned: 0 in 0.890s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5247035b-9725-4cc9-959b-79c25d881421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f119ba-b9fd-4074-b228-f6105b12cea2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa42723-68e8-4eb9-8fcc-8699837a9f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Volume volume-53f119ba-b9fd-4074-b228-f6105b12cea2 (53f119ba-b9fd-4074-b228-f6105b12cea2): created successfully Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa42723-68e8-4eb9-8fcc-8699837a9f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Flow 'volume_create_manager' (1d8341a3-3305-4f2b-8418-15ea3569ab0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6dc3f8b2-1856-4efc-9abe-a0fbab1e35c2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Created volume successfully. Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Flow 'volume_create_manager' (42366b1c-545c-4cb4-9806-52989eb167a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e6e954-b5da-405f-be30-2bd4cf972456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e6e954-b5da-405f-be30-2bd4cf972456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58efe7a5-aee9-493b-a871-8ab98b3b3098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1188c6eb38ae4f26a84adf3baf3df7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:58Z,use_quota=True,user_id='cfd64396e52f4370af7cffb1b5f1fcc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624d00b8-9ab4-4048-ae06-6b11f0f0a5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624d00b8-9ab4-4048-ae06-6b11f0f0a5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7a3093-270a-45c2-b519-1bbf978dddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7a3093-270a-45c2-b519-1bbf978dddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58efe7a5-aee9-493b-a871-8ab98b3b3098', 'volume_name': 'volume-58efe7a5-aee9-493b-a871-8ab98b3b3098', 'volume_size': 1, 'image_id': 'e61dc5b0-c973-44fb-b3b0-088049f488e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e61dc5b0-c973-44fb-b3b0-088049f488e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '270f2c4c7e6682d0a9edb124b9a6455a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1188c6eb38ae4f26a84adf3baf3df7d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '834a742c81333ea60308600f04e7058b7f2d43bfbe81f5f5e62d3f287a6f55912dd7234f09d827e82f7a00cd4af2c8b8670d799015c566b78a86621c91b50837', 'id': 'e61dc5b0-c973-44fb-b3b0-088049f488e8', 'created_at': datetime.datetime(2026, 7, 9, 13, 22, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e61dc5b0-c973-44fb-b3b0-088049f488e8/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8cde61-1474-4e64-b9e4-903f4149d017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8cde61-1474-4e64-b9e4-903f4149d017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d3a658-19c7-4d3c-a91f-b74a62bd8957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:22:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Volume 58efe7a5-aee9-493b-a871-8ab98b3b3098: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58efe7a5-aee9-493b-a871-8ab98b3b3098', 'volume_size': 1, 'image_id': 'e61dc5b0-c973-44fb-b3b0-088049f488e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e61dc5b0-c973-44fb-b3b0-088049f488e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '270f2c4c7e6682d0a9edb124b9a6455a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1188c6eb38ae4f26a84adf3baf3df7d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '834a742c81333ea60308600f04e7058b7f2d43bfbe81f5f5e62d3f287a6f55912dd7234f09d827e82f7a00cd4af2c8b8670d799015c566b78a86621c91b50837', 'id': 'e61dc5b0-c973-44fb-b3b0-088049f488e8', 'created_at': datetime.datetime(2026, 7, 9, 13, 22, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e61dc5b0-c973-44fb-b3b0-088049f488e8/file', 'properties': {}}, 'image_service': } Jul 09 15:22:58 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Trying to clone 58efe7a5-aee9-493b-a871-8ab98b3b3098 from image e61dc5b0-c973-44fb-b3b0-088049f488e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e61dc5b0-c973-44fb-b3b0-088049f488e8', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105" returned: 0 in 1.073s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:58 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105 Jul 09 15:22:58 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:22:59 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Image download 0.00 MB at 0.00 MB/s Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb520ae-266d-4c78-90e4-25d19a72a75a]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:59 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD Jul 09 15:22:59 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:22:59 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c16efeec-b072-41ca-a1f7-dfdc4401f105" returned: 0 in 0.817s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-c16efeec-b072-41ca-a1f7-dfdc4401f105" released by "delete_volume" :: held 1.958s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Created reservations ['44a6f0b1-4259-4054-bbac-618dfae05e06', '2950a37d-f224-449b-a304-28dc8e3dc657', 'ef112538-24e7-4f1d-8f3a-5a64e148cf57', 'b2395cac-77e6-4103-af67-a56813a891e7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:22:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:22:59 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:22:59 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-659a935a-d17d-4de6-ab1e-72bb38659334-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-659a935a-d17d-4de6-ab1e-72bb38659334-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-1bde5185-1bc5-4461-8285-dad6e4b5c078" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-1bde5185-1bc5-4461-8285-dad6e4b5c078" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-659a935a-d17d-4de6-ab1e-72bb38659334" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-659a935a-d17d-4de6-ab1e-72bb38659334" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Deleting offline snapshot 659a935a-d17d-4de6-ab1e-72bb38659334 of volume 1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] snapshot_file for this snap is: volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[71af33b2-0357-40e5-9d81-9fc769976e19]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:00 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD" returned: 0 in 1.153s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:00 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 Jul 09 15:23:00 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:00 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD Jul 09 15:23:00 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:00 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.880s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Deleted volume successfully. Jul 09 15:23:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7b66694b-36f4-413a-8eb2-a8ad6c993b04 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-c16efeec-b072-41ca-a1f7-dfdc4401f105-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:01 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD" returned: 1 in 0.812s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:01 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Temporary image e61dc5b0-c973-44fb-b3b0-088049f488e8 is fetched for user cfd64396e52f4370af7cffb1b5f1fcc2. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:23:01 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334" returned: 0 in 0.926s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bde5185-1bc5-4461-8285-dad6e4b5c078(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:23:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5dd7b3-a063-4dd7-9ccb-529db0e8c17a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d957f9a8-02f5-4da2-b232-59273a63fd40]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:01 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 Jul 09 15:23:01 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:01 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD Jul 09 15:23:01 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:02 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078" returned: 0 in 0.928s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:02 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD" returned: 0 in 0.929s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:02 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 Jul 09 15:23:02 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:02 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD Jul 09 15:23:02 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:02 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD" returned: 1 in 0.877s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58efe7a5-aee9-493b-a871-8ab98b3b3098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1188c6eb38ae4f26a84adf3baf3df7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:22:58Z,use_quota=True,user_id='cfd64396e52f4370af7cffb1b5f1fcc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Creating volume 58efe7a5-aee9-493b-a871-8ab98b3b3098 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:02 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:23:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:03 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 1073741824 Jul 09 15:23:03 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:03 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334" returned: 0 in 0.994s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:03 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334 Jul 09 15:23:03 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-8bd76514-4a72-47c7-bcb9-e0e8b68344df req-02fbc07d-ff8c-431a-bc67-06d1caaf62a2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:03 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078.659a935a-d17d-4de6-ab1e-72bb38659334" returned: 0 in 0.782s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-659a935a-d17d-4de6-ab1e-72bb38659334" released by "_delete_snapshot" :: held 3.767s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-1bde5185-1bc5-4461-8285-dad6e4b5c078" released by "delete_snapshot" :: held 3.794s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:03 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 1073741824" returned: 0 in 0.982s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Created reservations ['1cf20320-1a80-44a5-8ff5-40b680a3d354', '5383ac83-4f16-43c7-a0cf-4966da2a404d', 'a3eeb11f-6838-46db-8abb-438504008f95', '8d07f5b4-86a9-4336-9613-1872af4f698e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:04 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 Jul 09 15:23:04 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Delete snapshot completed successfully. Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4ccec2e5-06f3-4081-ba0c-efa54afbd284 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-659a935a-d17d-4de6-ab1e-72bb38659334-delete_snapshot" released by "delete_snapshot" :: held 4.005s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-1bde5185-1bc5-4461-8285-dad6e4b5c078-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-1bde5185-1bc5-4461-8285-dad6e4b5c078-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-1bde5185-1bc5-4461-8285-dad6e4b5c078" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-1bde5185-1bc5-4461-8285-dad6e4b5c078" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[823d41ed-2276-4247-ac38-61b0d4806a43]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:04 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098" returned: 0 in 0.694s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-8bd76514-4a72-47c7-bcb9-e0e8b68344df req-02fbc07d-ff8c-431a-bc67-06d1caaf62a2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.481s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d9b6d-16f6-4239-b0af-6a87a8064af8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-8bd76514-4a72-47c7-bcb9-e0e8b68344df req-02fbc07d-ff8c-431a-bc67-06d1caaf62a2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Attempting download of e61dc5b0-c973-44fb-b3b0-088049f488e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/e61dc5b0-c973-44fb-b3b0-088049f488e8', 'metadata': {}}])) to volume 58efe7a5-aee9-493b-a871-8ab98b3b3098. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:23:04 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 Jul 09 15:23:04 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3403ae7-86ba-49b9-a5cc-ca5262d956e2]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e61dc5b0-c973-44fb-b3b0-088049f488e8_0cpkbw45 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:04 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 Jul 09 15:23:04 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:05 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e61dc5b0-c973-44fb-b3b0-088049f488e8_0cpkbw45 Jul 09 15:23:05 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:05 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078" returned: 0 in 0.983s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:05 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078 Jul 09 15:23:05 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:05 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-8bd76514-4a72-47c7-bcb9-e0e8b68344df req-02fbc07d-ff8c-431a-bc67-06d1caaf62a2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2" returned: 0 in 0.950s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-8bd76514-4a72-47c7-bcb9-e0e8b68344df req-02fbc07d-ff8c-431a-bc67-06d1caaf62a2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-8bd76514-4a72-47c7-bcb9-e0e8b68344df req-02fbc07d-ff8c-431a-bc67-06d1caaf62a2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-53f119ba-b9fd-4074-b228-f6105b12cea2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e4ea132-d726-454b-84a5-685ce0152ec5', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:23:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-8bd76514-4a72-47c7-bcb9-e0e8b68344df req-02fbc07d-ff8c-431a-bc67-06d1caaf62a2 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] attachment_update completed successfully. Jul 09 15:23:05 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e61dc5b0-c973-44fb-b3b0-088049f488e8_0cpkbw45" returned: 0 in 1.132s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e61dc5b0-c973-44fb-b3b0-088049f488e8_0cpkbw45 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:06 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e61dc5b0-c973-44fb-b3b0-088049f488e8_0cpkbw45 Jul 09 15:23:06 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:06 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1bde5185-1bc5-4461-8285-dad6e4b5c078" returned: 0 in 0.938s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-1bde5185-1bc5-4461-8285-dad6e4b5c078" released by "delete_volume" :: held 2.027s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Created reservations ['28f92449-e159-4aa5-9ed6-413491a1a601', '959f36e8-b3b8-4fdb-b0b4-b140bdf61eb9', 'aa8f0580-4619-4e1a-808a-26e6f21a970f', '938752d3-592a-4c69-8815-ff6a78e2bc46'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:06 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:23:06 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:07 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e61dc5b0-c973-44fb-b3b0-088049f488e8_0cpkbw45" returned: 1 in 1.124s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e61dc5b0-c973-44fb-b3b0-088049f488e8_0cpkbw45' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d3b3cd-8744-4731-baa7-86d3476939ba]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:07 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD Jul 09 15:23:07 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:07 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.774s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:07 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Deleted volume successfully. Jul 09 15:23:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bbf58759-e3d4-4244-a967-7d1cae09e7a8 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-1bde5185-1bc5-4461-8285-dad6e4b5c078-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:08 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD" returned: 0 in 0.918s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:08 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD Jul 09 15:23:08 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Flow 'volume_create_manager' (cb3943f1-cbc2-43fa-931e-b28f6fb997c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc694e5-4a86-47b0-8d4e-a487eab7a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc694e5-4a86-47b0-8d4e-a487eab7a46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1057434371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce91db4-7c04-4089-acf5-9922dcf306fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0cd826f8548ccb768699030f0bc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:08Z,use_quota=True,user_id='ee008504b96042369161ba4e78bd2a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d419997-90f9-498f-8c4d-86cc631a1b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d419997-90f9-498f-8c4d-86cc631a1b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f4a128-4da3-4ebd-994f-3912af49eff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f4a128-4da3-4ebd-994f-3912af49eff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce91db4-7c04-4089-acf5-9922dcf306fd', 'volume_name': 'volume-7ce91db4-7c04-4089-acf5-9922dcf306fd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0a6fd2-849b-408e-a3e0-e217dd7edd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0a6fd2-849b-408e-a3e0-e217dd7edd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef0aa5f-0265-4c9f-bef3-352cff67e172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Volume 7ce91db4-7c04-4089-acf5-9922dcf306fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce91db4-7c04-4089-acf5-9922dcf306fd', 'volume_size': 1} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1057434371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce91db4-7c04-4089-acf5-9922dcf306fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0cd826f8548ccb768699030f0bc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:08Z,use_quota=True,user_id='ee008504b96042369161ba4e78bd2a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Creating volume 7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:08 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:08 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd 1073741824 Jul 09 15:23:08 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:08 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD" returned: 1 in 0.790s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] e61dc5b0-c973-44fb-b3b0-088049f488e8 was raw, converting to raw {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:23:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:08 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 Jul 09 15:23:08 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:09 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd 1073741824" returned: 0 in 1.103s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:09 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098" returned: 0 in 0.932s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:09 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e61dc5b0-c973-44fb-b3b0-088049f488e8_pzr7myrqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:23:09 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 15:23:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:09 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 1G Jul 09 15:23:09 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:09 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd Jul 09 15:23:09 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:10 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd" returned: 0 in 0.812s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:10 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 1G" returned: 0 in 0.870s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef0aa5f-0265-4c9f-bef3-352cff67e172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce91db4-7c04-4089-acf5-9922dcf306fd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1332bfc1-cf7d-4122-be70-322f479b580f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Volume volume-7ce91db4-7c04-4089-acf5-9922dcf306fd (7ce91db4-7c04-4089-acf5-9922dcf306fd): created successfully Jul 09 15:23:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1332bfc1-cf7d-4122-be70-322f479b580f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Flow 'volume_create_manager' (cb3943f1-cbc2-43fa-931e-b28f6fb997c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:10 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea2e43a-02d5-4a76-ab01-20fba1be3a79]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e76acd0a-1d86-42d4-9036-e3d6664f8441 tempest-VolumesSnapshotTestJSON-377089321 None] Created volume successfully. Jul 09 15:23:10 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 Jul 09 15:23:10 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:11 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098" returned: 0 in 0.902s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:11 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 Jul 09 15:23:11 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Creating offline snapshot 1d71cb13-d731-45aa-b5e5-dd0b5580ef02 of volume 7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c699cbf-3abb-4a09-b606-64ca786f6eb6]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:12 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd Jul 09 15:23:12 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:12 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098" returned: 1 in 0.933s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Downloaded image e61dc5b0-c973-44fb-b3b0-088049f488e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/e61dc5b0-c973-44fb-b3b0-088049f488e8', 'metadata': {}}])) to volume 58efe7a5-aee9-493b-a871-8ab98b3b3098 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Temporary image e61dc5b0-c973-44fb-b3b0-088049f488e8 for user cfd64396e52f4370af7cffb1b5f1fcc2 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Marking volume 58efe7a5-aee9-493b-a871-8ab98b3b3098 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Copying metadata from image e61dc5b0-c973-44fb-b3b0-088049f488e8 to 58efe7a5-aee9-493b-a871-8ab98b3b3098. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Creating volume glance metadata for volume 58efe7a5-aee9-493b-a871-8ab98b3b3098 backed by image e61dc5b0-c973-44fb-b3b0-088049f488e8 with: {'image_id': 'e61dc5b0-c973-44fb-b3b0-088049f488e8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '270f2c4c7e6682d0a9edb124b9a6455a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d3a658-19c7-4d3c-a91f-b74a62bd8957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58efe7a5-aee9-493b-a871-8ab98b3b3098', 'volume_size': 1, 'image_id': 'e61dc5b0-c973-44fb-b3b0-088049f488e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e61dc5b0-c973-44fb-b3b0-088049f488e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '270f2c4c7e6682d0a9edb124b9a6455a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1188c6eb38ae4f26a84adf3baf3df7d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '834a742c81333ea60308600f04e7058b7f2d43bfbe81f5f5e62d3f287a6f55912dd7234f09d827e82f7a00cd4af2c8b8670d799015c566b78a86621c91b50837', 'id': 'e61dc5b0-c973-44fb-b3b0-088049f488e8', 'created_at': datetime.datetime(2026, 7, 9, 13, 22, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e61dc5b0-c973-44fb-b3b0-088049f488e8/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e03dd2-0c55-4fbd-a5dd-65efeafa9206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Volume volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 (58efe7a5-aee9-493b-a871-8ab98b3b3098): created successfully Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e03dd2-0c55-4fbd-a5dd-65efeafa9206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Flow 'volume_create_manager' (42366b1c-545c-4cb4-9806-52989eb167a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e23433aa-45a6-450b-b0e6-633b12ee31bd tempest-VolumeImageDependencyTests-1293886075 None] Created volume successfully. Jul 09 15:23:13 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd" returned: 0 in 1.049s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:13 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 1G Jul 09 15:23:13 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Acquiring lock "cinder-58efe7a5-aee9-493b-a871-8ab98b3b3098-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Lock "cinder-58efe7a5-aee9-493b-a871-8ab98b3b3098-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Acquiring lock "cinder-quobyte-58efe7a5-aee9-493b-a871-8ab98b3b3098" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Lock "cinder-quobyte-58efe7a5-aee9-493b-a871-8ab98b3b3098" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[546c38d5-a487-47d7-9f3c-28a213143791]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:13 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 Jul 09 15:23:13 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-41cade5b-38be-4c6a-a488-026b7cb675b9 req-1a715e2b-51e7-4e38-a789-9ae2fd8addb1 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Terminate volume connection completed successfully. Jul 09 15:23:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-41cade5b-38be-4c6a-a488-026b7cb675b9 req-1a715e2b-51e7-4e38-a789-9ae2fd8addb1 tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Deleting attachment 2e4ea132-d726-454b-84a5-685ce0152ec5. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:23:14 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 1G" returned: 0 in 1.095s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce91db4-7c04-4089-acf5-9922dcf306fd -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:14 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce91db4-7c04-4089-acf5-9922dcf306fd -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 Jul 09 15:23:14 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:14 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098" returned: 0 in 0.923s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:14 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 Jul 09 15:23:14 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:15 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce91db4-7c04-4089-acf5-9922dcf306fd -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02" returned: 0 in 0.882s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:15 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 is being set with open permissions: ugo+rw Jul 09 15:23:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:15 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 Jul 09 15:23:15 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:15 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098" returned: 1 in 0.877s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:15 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098 Jul 09 15:23:15 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Acquiring lock "cinder-53f119ba-b9fd-4074-b228-f6105b12cea2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "cinder-53f119ba-b9fd-4074-b228-f6105b12cea2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Acquiring lock "cinder-quobyte-53f119ba-b9fd-4074-b228-f6105b12cea2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "cinder-quobyte-53f119ba-b9fd-4074-b228-f6105b12cea2" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cd5777-1d2e-4669-a0fb-a9e966069824]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:16 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:16 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-58efe7a5-aee9-493b-a871-8ab98b3b3098" returned: 0 in 0.830s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02" returned: 0 in 0.928s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Lock "cinder-quobyte-58efe7a5-aee9-493b-a871-8ab98b3b3098" released by "delete_volume" :: held 2.720s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:16 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 Jul 09 15:23:16 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:16 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.info Jul 09 15:23:16 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Created reservations ['ec288cfd-3168-467f-a28f-9b753dbdecb5', '8290a2d1-1b4f-40fc-abff-4cb185444e71', '453ec3ea-3f4f-4c54-a04a-8e231ab2251d', 'd2bcb9ed-75de-49be-baf3-58efbbc2fa4b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:16 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:23:16 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Flow 'volume_create_manager' (9a1e395d-0723-4abc-b245-d9894641cc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c35a175-e043-479e-9ec9-f6315e362803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c35a175-e043-479e-9ec9-f6315e362803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-234417946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e31f98c-5a3a-447e-9801-c0d0cd38e78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='423ae806886a4d2eaeffcae1c993ddcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:16Z,use_quota=True,user_id='cf941dfa51ae4e509aa407cc19fe90a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67974822-794c-471f-8b1a-d58cb5e2addd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67974822-794c-471f-8b1a-d58cb5e2addd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cef2327-73cc-41a8-9248-ad3a58fdd16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cef2327-73cc-41a8-9248-ad3a58fdd16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e31f98c-5a3a-447e-9801-c0d0cd38e78b', 'volume_name': 'volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843732ba-0841-4ea8-ab99-4a7417dc7a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843732ba-0841-4ea8-ab99-4a7417dc7a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb7ced2-d1ae-4230-bbf4-a7efe25a3e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Volume 4e31f98c-5a3a-447e-9801-c0d0cd38e78b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b', 'volume_size': 1} Jul 09 15:23:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:17 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2" returned: 0 in 1.130s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:17 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.info" returned: 0 in 0.970s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:17 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.info is being set with open permissions: ugo+rw Jul 09 15:23:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:17 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:17 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2 Jul 09 15:23:17 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.828s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:17 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Deleted volume successfully. Jul 09 15:23:17 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.info Jul 09 15:23:17 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f8f460a6-e036-4d55-bca0-2b43c75f911d tempest-VolumeImageDependencyTests-1293886075 None] Lock "cinder-58efe7a5-aee9-493b-a871-8ab98b3b3098-delete_volume" released by "delete_volume" :: held 3.901s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.info" returned: 0 in 0.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:17 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.909s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-234417946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e31f98c-5a3a-447e-9801-c0d0cd38e78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='423ae806886a4d2eaeffcae1c993ddcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:16Z,use_quota=True,user_id='cf941dfa51ae4e509aa407cc19fe90a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Creating volume 4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:18 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:23:18 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-53f119ba-b9fd-4074-b228-f6105b12cea2" returned: 0 in 0.921s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:18 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b 1073741824 Jul 09 15:23:18 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "cinder-quobyte-53f119ba-b9fd-4074-b228-f6105b12cea2" released by "delete_volume" :: held 2.137s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-79caa60c-572e-47da-8698-65adaed49248 tempest-VolumesSnapshotTestJSON-377089321 None] Create snapshot completed successfully Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Created reservations ['26949855-6847-467d-8e19-6461f8966cad', 'a0cbc327-ad72-42ff-9e2c-46d88b5b9856', '9e7e9dc5-62d0-4ffd-9d3c-aac1b6aa7f13', 'd9b0ab61-b4cf-4c68-a807-6b620e26b761'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:18 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:23:18 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:19 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Flow 'volume_create_manager' (c907ff3c-4e7d-4442-b95b-d344818d136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7562d1ac-b69a-4d84-8c96-6df531ccb009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.983s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Deleted volume successfully. Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7562d1ac-b69a-4d84-8c96-6df531ccb009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-451452796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e0ca82-d67b-46f9-bf64-f401ece3de2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0cd826f8548ccb768699030f0bc93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1d71cb13-d731-45aa-b5e5-dd0b5580ef02,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:19Z,use_quota=True,user_id='ee008504b96042369161ba4e78bd2a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:19 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90493d3-309b-43c6-9f8a-f6f314370856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90493d3-309b-43c6-9f8a-f6f314370856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae73e05-700c-486a-a71c-ca1a6ccff9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae73e05-700c-486a-a71c-ca1a6ccff9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a4e0ca82-d67b-46f9-bf64-f401ece3de2d', 'volume_name': 'volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d', 'volume_size': 1, 'snapshot_id': '1d71cb13-d731-45aa-b5e5-dd0b5580ef02'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbde58fc-4810-449a-9791-c8b6d5481636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbde58fc-4810-449a-9791-c8b6d5481636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cadee45-3603-493e-a622-63905981e677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Volume a4e0ca82-d67b-46f9-bf64-f401ece3de2d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d', 'volume_size': 1, 'snapshot_id': '1d71cb13-d731-45aa-b5e5-dd0b5580ef02'} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b 1073741824" returned: 0 in 1.405s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-60dbfa6a-22da-409f-8678-eff9bfdaa1ec tempest-TestServerVolumeAttachScenarioOldVersion-373686992 None] Lock "cinder-53f119ba-b9fd-4074-b228-f6105b12cea2-delete_volume" released by "delete_volume" :: held 3.568s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:19 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b Jul 09 15:23:19 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:20 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" returned: 0 in 0.799s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.848s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-1d71cb13-d731-45aa-b5e5-dd0b5580ef02-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb7ced2-d1ae-4230-bbf4-a7efe25a3e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc52644f-a131-4406-81bb-aee259605f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-1d71cb13-d731-45aa-b5e5-dd0b5580ef02-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Creating volume a4e0ca82-d67b-46f9-bf64-f401ece3de2d from snapshot 1d71cb13-d731-45aa-b5e5-dd0b5580ef02 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Volume volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b (4e31f98c-5a3a-447e-9801-c0d0cd38e78b): created successfully Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc52644f-a131-4406-81bb-aee259605f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Flow 'volume_create_manager' (9a1e395d-0723-4abc-b245-d9894641cc88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] snapshot: 1d71cb13-d731-45aa-b5e5-dd0b5580ef02, volume: a4e0ca82-d67b-46f9-bf64-f401ece3de2d, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:23:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d6a7996a-85c1-4798-8ae8-2b4e76459cb7 tempest-TestStampPattern-1299061683 None] Created volume successfully. Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c92dcd8-f147-4c1a-b370-b9f1877cc635]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:20 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 Jul 09 15:23:20 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Flow 'volume_create_manager' (0826bd5d-9969-47ef-a027-dcb13f0f24be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9756e9de-d424-4182-acb2-e82f90d7fc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9756e9de-d424-4182-acb2-e82f90d7fc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec85088-3053-4b6c-8379-9ec065beb2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a05790139244774bfe87548b4dd24a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:21Z,use_quota=True,user_id='117f9cf5cbae426b8646860fc1f2b9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2214695f-181b-4bae-b583-a30299d98736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2214695f-181b-4bae-b583-a30299d98736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d3b679-8233-4f49-bd13-176df8d7463c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d3b679-8233-4f49-bd13-176df8d7463c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ec85088-3053-4b6c-8379-9ec065beb2c1', 'volume_name': 'volume-4ec85088-3053-4b6c-8379-9ec065beb2c1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b75143-a2d1-4827-aee7-5bff50ab8920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b75143-a2d1-4827-aee7-5bff50ab8920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b57d81-63b4-43aa-8512-857ab14cad0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Volume 4ec85088-3053-4b6c-8379-9ec065beb2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ec85088-3053-4b6c-8379-9ec065beb2c1', 'volume_size': 1} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:21 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02" returned: 0 in 1.004s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce91db4-7c04-4089-acf5-9922dcf306fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b435b1-3606-4452-bd0f-81e2d6453993]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:21 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd Jul 09 15:23:21 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:22 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd" returned: 0 in 0.839s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:22 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:23:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:22 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d Jul 09 15:23:22 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:28 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" returned: 0 in 6.122s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b041aa18-13d8-43d8-8615-2f1714932bed]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:28 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd Jul 09 15:23:28 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:29 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd" returned: 0 in 0.967s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:29 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:23:29 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Converted 1024.00 MB image at 167.20 MB/s Jul 09 15:23:29 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d is being set with open permissions: ugo+rw Jul 09 15:23:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:29 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d Jul 09 15:23:29 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:30 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" returned: 0 in 0.704s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" released by "_copy_volume_from_snapshot" :: held 9.763s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-1d71cb13-d731-45aa-b5e5-dd0b5580ef02-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" released by "_create_volume_from_snapshot" :: held 9.815s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.847s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.837s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec85088-3053-4b6c-8379-9ec065beb2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a05790139244774bfe87548b4dd24a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:21Z,use_quota=True,user_id='117f9cf5cbae426b8646860fc1f2b9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Creating volume 4ec85088-3053-4b6c-8379-9ec065beb2c1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:30 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1 1073741824 Jul 09 15:23:30 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cadee45-3603-493e-a622-63905981e677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d', 'volume_size': 1, 'snapshot_id': '1d71cb13-d731-45aa-b5e5-dd0b5580ef02'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1356fdee-45e3-4387-81ca-6466335fbe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Volume volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d (a4e0ca82-d67b-46f9-bf64-f401ece3de2d): created successfully Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1356fdee-45e3-4387-81ca-6466335fbe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Flow 'volume_create_manager' (c907ff3c-4e7d-4442-b95b-d344818d136d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0861b585-baba-4131-b739-ea803222a5be tempest-VolumesSnapshotTestJSON-377089321 None] Created volume successfully. Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-a4e0ca82-d67b-46f9-bf64-f401ece3de2d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-a4e0ca82-d67b-46f9-bf64-f401ece3de2d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8589f6-f9ce-449d-bf45-cda03cbafcd6]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:30 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d Jul 09 15:23:30 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:31 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1 1073741824" returned: 0 in 1.306s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:31 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1 Jul 09 15:23:31 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:31 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" returned: 0 in 1.209s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:31 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d Jul 09 15:23:31 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:32 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1" returned: 0 in 0.937s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.316s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b57d81-63b4-43aa-8512-857ab14cad0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ec85088-3053-4b6c-8379-9ec065beb2c1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6af903-7db8-47df-9509-1e1221656d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Volume volume-4ec85088-3053-4b6c-8379-9ec065beb2c1 (4ec85088-3053-4b6c-8379-9ec065beb2c1): created successfully Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6af903-7db8-47df-9509-1e1221656d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Flow 'volume_create_manager' (0826bd5d-9969-47ef-a027-dcb13f0f24be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3315084d-b4fe-498b-b936-5fad2766ab52 tempest-CinderUnicodeTest-1233431988 None] Created volume successfully. Jul 09 15:23:32 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" returned: 0 in 0.781s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-a4e0ca82-d67b-46f9-bf64-f401ece3de2d" released by "delete_volume" :: held 2.038s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Created reservations ['ad9f0710-c96e-487f-8ee7-2548410384e3', '226cc5c2-d974-4d5f-96f7-a697a9c92ea0', '5a4dbc58-bb50-45b7-9c59-fbe4da51f017', '08a728e6-7148-4ee8-a8a4-4b34e37f4ac8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:32 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:23:32 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:33 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.978s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:33 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Deleted volume successfully. Jul 09 15:23:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-162a84b0-a30a-468d-9d9c-2659e8092b29 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-a4e0ca82-d67b-46f9-bf64-f401ece3de2d-delete_volume" released by "delete_volume" :: held 3.327s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-1d71cb13-d731-45aa-b5e5-dd0b5580ef02-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-1d71cb13-d731-45aa-b5e5-dd0b5580ef02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-7ce91db4-7c04-4089-acf5-9922dcf306fd" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-7ce91db4-7c04-4089-acf5-9922dcf306fd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-1d71cb13-d731-45aa-b5e5-dd0b5580ef02" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-1d71cb13-d731-45aa-b5e5-dd0b5580ef02" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Deleting offline snapshot 1d71cb13-d731-45aa-b5e5-dd0b5580ef02 of volume 7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] snapshot_file for this snap is: volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc758f8-97e7-495e-bb25-c453cbdd0bf0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:34 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 Jul 09 15:23:34 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Flow 'volume_create_manager' (19bf3af3-bb68-48f2-bbca-9cb4487540e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d8a757-b9be-4e12-ada3-44d5340da0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d8a757-b9be-4e12-ada3-44d5340da0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-113299968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57b9b53-e1ce-45d3-9802-73a82f9d9ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a05790139244774bfe87548b4dd24a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:34Z,use_quota=True,user_id='117f9cf5cbae426b8646860fc1f2b9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6307f1d4-ff8a-4ff1-84ec-e85925c37c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6307f1d4-ff8a-4ff1-84ec-e85925c37c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b2ef42-20e1-4822-b3bd-55f5548501cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b2ef42-20e1-4822-b3bd-55f5548501cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57b9b53-e1ce-45d3-9802-73a82f9d9ccd', 'volume_name': 'volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377e1e1f-e772-46a3-85e9-bd1150ec758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377e1e1f-e772-46a3-85e9-bd1150ec758d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a375f87d-6ce6-4be1-a17d-e7da3fd6d7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Volume b57b9b53-e1ce-45d3-9802-73a82f9d9ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd', 'volume_size': 1} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-113299968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57b9b53-e1ce-45d3-9802-73a82f9d9ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a05790139244774bfe87548b4dd24a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:34Z,use_quota=True,user_id='117f9cf5cbae426b8646860fc1f2b9c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Creating volume b57b9b53-e1ce-45d3-9802-73a82f9d9ccd {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:34 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:23:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:34 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd 1073741824 Jul 09 15:23:34 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:35 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02" returned: 0 in 1.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce91db4-7c04-4089-acf5-9922dcf306fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:23:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad4cb97-22d6-4615-84bb-46fd88c46d18]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:35 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd Jul 09 15:23:35 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:36 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd 1073741824" returned: 0 in 1.587s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:36 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd Jul 09 15:23:36 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:36 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd" returned: 0 in 1.242s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:36 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 Jul 09 15:23:36 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:37 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" returned: 0 in 1.025s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] <== create_volume: return (2724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.728s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a375f87d-6ce6-4be1-a17d-e7da3fd6d7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465818d2-9b99-4272-9c0f-b81a13c72991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Volume volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd (b57b9b53-e1ce-45d3-9802-73a82f9d9ccd): created successfully Jul 09 15:23:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465818d2-9b99-4272-9c0f-b81a13c72991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Flow 'volume_create_manager' (19bf3af3-bb68-48f2-bbca-9cb4487540e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-01dbc649-b666-48cf-81c9-95d47c9684a6 tempest-CinderUnicodeTest-1233431988 None] Created volume successfully. Jul 09 15:23:37 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02" returned: 0 in 1.198s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:38 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02 Jul 09 15:23:38 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Creating offline snapshot d4f52360-9bbe-4d8f-9dd8-f2240f67e179 of volume b57b9b53-e1ce-45d3-9802-73a82f9d9ccd {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:23:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[99654196-023e-41ea-8765-fcf1e89c1f2a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:38 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd Jul 09 15:23:38 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:39 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd.1d71cb13-d731-45aa-b5e5-dd0b5580ef02" returned: 0 in 1.033s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-1d71cb13-d731-45aa-b5e5-dd0b5580ef02" released by "_delete_snapshot" :: held 4.984s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-7ce91db4-7c04-4089-acf5-9922dcf306fd" released by "delete_snapshot" :: held 5.013s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Created reservations ['71c1099d-3a87-4c92-bf37-fec5332764ae', '46a8a5a6-3f50-4fdf-870a-2af19516da34', '1ca41e60-7d7e-437b-90b7-2fa06be6c037', 'd3c85dc9-675f-4f51-b9eb-726c813f3802'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Delete snapshot completed successfully. Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4af86fca-1723-45e3-8958-bc91dbbdb5d0 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-1d71cb13-d731-45aa-b5e5-dd0b5580ef02-delete_snapshot" released by "delete_snapshot" :: held 5.266s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-7ce91db4-7c04-4089-acf5-9922dcf306fd-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-7ce91db4-7c04-4089-acf5-9922dcf306fd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-7ce91db4-7c04-4089-acf5-9922dcf306fd" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:39 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-7ce91db4-7c04-4089-acf5-9922dcf306fd" acquired by "delete_volume" :: waited 0.046s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" returned: 0 in 1.556s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4477258d-9178-4f1e-8d8f-4a97c564518c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:39 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 1G Jul 09 15:23:39 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:40 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd Jul 09 15:23:40 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:41 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd" returned: 0 in 1.386s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:41 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd Jul 09 15:23:41 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:41 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 1G" returned: 0 in 1.582s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:41 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 Jul 09 15:23:41 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:42 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7ce91db4-7c04-4089-acf5-9922dcf306fd" returned: 0 in 1.100s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-7ce91db4-7c04-4089-acf5-9922dcf306fd" released by "delete_volume" :: held 2.577s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Created reservations ['141bb182-8185-4e69-a362-58b8209e9e89', '233f540e-c003-4103-bc3a-37b9cb3e2bc4', '76502364-0a3f-4ae4-ae1e-2de12ea53b27', '09ae0ff4-bdfc-40e3-84df-f08a98fc11d7'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:42 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:23:42 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:42 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179" returned: 0 in 1.291s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:42 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 is being set with open permissions: ugo+rw Jul 09 15:23:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:42 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 Jul 09 15:23:42 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-00e53574-60b4-4070-82e0-ab791e100804-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-00e53574-60b4-4070-82e0-ab791e100804-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "cinder-quobyte-00e53574-60b4-4070-82e0-ab791e100804" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-00e53574-60b4-4070-82e0-ab791e100804" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2572326-0bff-461f-9969-c74b2d04ed06]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:43 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.069s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Deleted volume successfully. Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8c2ddae3-c834-49ca-9cd6-66194c04d6a2 tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-7ce91db4-7c04-4089-acf5-9922dcf306fd-delete_volume" released by "delete_volume" :: held 4.073s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:43 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 Jul 09 15:23:43 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:43 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179" returned: 0 in 1.187s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:43 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.info Jul 09 15:23:43 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:44 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804" returned: 0 in 1.022s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:44 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804 Jul 09 15:23:44 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:44 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.info" returned: 0 in 0.936s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:44 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.info is being set with open permissions: ugo+rw Jul 09 15:23:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:44 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.info Jul 09 15:23:44 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:45 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-00e53574-60b4-4070-82e0-ab791e100804" returned: 0 in 0.890s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-quobyte-00e53574-60b4-4070-82e0-ab791e100804" released by "delete_volume" :: held 1.989s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:45 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.info" returned: 0 in 0.766s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.463s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Created reservations ['10bcd15a-1309-4ee7-9961-c70466edf9c6', 'd327c76f-89c9-4cea-8f2c-f5b604ec728e', '3815a13d-81b0-4422-8e71-65158009aba4', '6369f933-dd5a-4406-bb07-75c6336c73b6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1d6e390b-c961-45d8-8e3d-b958fd167471 tempest-CinderUnicodeTest-1233431988 None] Create snapshot completed successfully Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:45 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:23:45 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:46 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.682s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Deleted volume successfully. Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27ec8936-93ee-4388-a9fd-c4c2d31638ae tempest-VolumesSnapshotTestJSON-377089321 None] Lock "cinder-00e53574-60b4-4070-82e0-ab791e100804-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "cinder-d4f52360-9bbe-4d8f-9dd8-f2240f67e179-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-d4f52360-9bbe-4d8f-9dd8-f2240f67e179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "cinder-quobyte-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-quobyte-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "cinder-quobyte-d4f52360-9bbe-4d8f-9dd8-f2240f67e179" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-quobyte-d4f52360-9bbe-4d8f-9dd8-f2240f67e179" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Deleting offline snapshot d4f52360-9bbe-4d8f-9dd8-f2240f67e179 of volume b57b9b53-e1ce-45d3-9802-73a82f9d9ccd {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] snapshot_file for this snap is: volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d066bdee-a133-419b-9eea-c129fe58335c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:47 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 Jul 09 15:23:47 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:47 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:23:47 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:47 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179" returned: 0 in 0.888s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da25b7e-806c-4fae-a30b-190b105ce867]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:48 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd Jul 09 15:23:48 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:48 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.767s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:23:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:23:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:23:48 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" returned: 0 in 0.946s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:48 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 Jul 09 15:23:48 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:49 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179" returned: 0 in 0.815s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:49 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179 Jul 09 15:23:49 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Flow 'volume_create_manager' (37b1bcfc-2c30-4b1d-bcc1-55e305877d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4011e4e3-4930-40ab-bba5-e3de99178a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4011e4e3-4930-40ab-bba5-e3de99178a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f451fb8a-fd66-48c2-9ab3-39149a8f71dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63bdf7d0da04d78aee8670b7238a87c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:50Z,use_quota=True,user_id='b893f8ac05fa4108aa44a7d52321a970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8947b41-22fb-48ab-864b-7ce261526c69),volume_type_id=b8947b41-22fb-48ab-864b-7ce261526c69)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be800d7f-b6ca-4c5c-90f0-227e3c77def4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be800d7f-b6ca-4c5c-90f0-227e3c77def4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34824ad7-91b3-438e-b3b0-502583999a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:23:50 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd.d4f52360-9bbe-4d8f-9dd8-f2240f67e179" returned: 0 in 0.748s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-quobyte-d4f52360-9bbe-4d8f-9dd8-f2240f67e179" released by "_delete_snapshot" :: held 3.546s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-quobyte-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" released by "delete_snapshot" :: held 3.589s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Created reservations ['1c20f1d1-0898-4f96-9ac4-58dcb15aa2cf', 'a4ad0926-889d-42d4-9646-abdfa2dd66c5', '91bc68bf-ae5b-4d1c-a406-4d0930159422', 'a7dafaeb-fbfc-4131-a88e-6f179cc2e5cf'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34824ad7-91b3-438e-b3b0-502583999a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f451fb8a-fd66-48c2-9ab3-39149a8f71dd', 'volume_name': 'volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd', 'volume_size': 1, 'image_id': 'cc681eb4-3907-4740-a2c7-1541678646a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc681eb4-3907-4740-a2c7-1541678646a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80ab3dde37866c40e14e3473db2efd48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd63bdf7d0da04d78aee8670b7238a87c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5be6dd6c819bf811bb8cc98e4ae24acd5a8655342d51325785c18f55fb9c282c82ec14a8c7a89371985bc3d5cb2ae60ed4b1dc49c10a0e8fba93f6887117166a', 'id': 'cc681eb4-3907-4740-a2c7-1541678646a2', 'created_at': datetime.datetime(2026, 7, 9, 13, 23, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 23, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc681eb4-3907-4740-a2c7-1541678646a2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139e3525-4181-4d8b-bc21-de168debd0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139e3525-4181-4d8b-bc21-de168debd0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7d19ce-4370-4528-aea4-24bc401895c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:23:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Volume f451fb8a-fd66-48c2-9ab3-39149a8f71dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd', 'volume_size': 1, 'image_id': 'cc681eb4-3907-4740-a2c7-1541678646a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc681eb4-3907-4740-a2c7-1541678646a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80ab3dde37866c40e14e3473db2efd48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd63bdf7d0da04d78aee8670b7238a87c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5be6dd6c819bf811bb8cc98e4ae24acd5a8655342d51325785c18f55fb9c282c82ec14a8c7a89371985bc3d5cb2ae60ed4b1dc49c10a0e8fba93f6887117166a', 'id': 'cc681eb4-3907-4740-a2c7-1541678646a2', 'created_at': datetime.datetime(2026, 7, 9, 13, 23, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 23, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc681eb4-3907-4740-a2c7-1541678646a2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Trying to clone f451fb8a-fd66-48c2-9ab3-39149a8f71dd from image cc681eb4-3907-4740-a2c7-1541678646a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc681eb4-3907-4740-a2c7-1541678646a2', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:23:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Delete snapshot completed successfully. Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-27b9093e-bc5a-4f51-a4c2-9f9075106c49 tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-d4f52360-9bbe-4d8f-9dd8-f2240f67e179-delete_snapshot" released by "delete_snapshot" :: held 3.850s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:23:50 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Image download 0.00 MB at 0.00 MB/s Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[113c4b0a-9cb3-45d9-bb5e-1df75accde4b]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:50 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD Jul 09 15:23:50 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "cinder-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "cinder-quobyte-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-quobyte-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" acquired by "delete_volume" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ee63d6-52c4-4add-a16d-92f101b9dcfb]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:51 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd Jul 09 15:23:51 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:51 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD" returned: 0 in 0.871s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:51 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD Jul 09 15:23:51 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:52 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" returned: 0 in 0.871s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:52 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd Jul 09 15:23:52 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:52 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD" returned: 1 in 0.826s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Temporary image cc681eb4-3907-4740-a2c7-1541678646a2 is fetched for user b893f8ac05fa4108aa44a7d52321a970. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[62faf2c3-3930-429a-94bf-8baf8056030c]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:52 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD Jul 09 15:23:52 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:52 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" returned: 0 in 0.716s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-quobyte-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd" released by "delete_volume" :: held 1.656s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Created reservations ['ded67fe6-c726-4441-8fe1-3c455e95a661', 'fec4ddbb-d65c-4e10-bda3-0dc57ae165b8', '7720cc0e-8aed-42c5-8a68-8e6107044bbf', 'ca882b7d-29eb-49f3-8d18-c8fde3e913cd'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:53 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:23:53 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:53 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "cinder-4ec85088-3053-4b6c-8379-9ec065beb2c1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-4ec85088-3053-4b6c-8379-9ec065beb2c1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:53 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD Jul 09 15:23:53 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "cinder-quobyte-4ec85088-3053-4b6c-8379-9ec065beb2c1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-quobyte-4ec85088-3053-4b6c-8379-9ec065beb2c1" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7c8323-0abb-4f96-9b1d-5655937b2cc4]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:53 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.774s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Deleted volume successfully. Jul 09 15:23:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-935b141c-92e6-4047-85bc-b1bf1b3f031d tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-b57b9b53-e1ce-45d3-9802-73a82f9d9ccd-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:53 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1 Jul 09 15:23:53 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:54 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD" returned: 1 in 0.948s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f451fb8a-fd66-48c2-9ab3-39149a8f71dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63bdf7d0da04d78aee8670b7238a87c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:23:50Z,use_quota=True,user_id='b893f8ac05fa4108aa44a7d52321a970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8947b41-22fb-48ab-864b-7ce261526c69),volume_type_id=b8947b41-22fb-48ab-864b-7ce261526c69)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Creating volume f451fb8a-fd66-48c2-9ab3-39149a8f71dd {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:23:54 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:54 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd 1073741824 Jul 09 15:23:54 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:54 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1" returned: 0 in 1.009s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:54 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1 Jul 09 15:23:54 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:55 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd 1073741824" returned: 0 in 1.069s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:55 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ec85088-3053-4b6c-8379-9ec065beb2c1" returned: 0 in 0.814s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-quobyte-4ec85088-3053-4b6c-8379-9ec065beb2c1" released by "delete_volume" :: held 1.887s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:55 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd Jul 09 15:23:55 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Created reservations ['2720ea27-d2de-48db-901c-91510d2c879c', 'e1779c02-6705-4290-a95c-a84874a6c915', '3d0fd867-708f-4cbf-bbdd-b146c0d149a5', 'b3013eef-d2bf-410d-86d1-8bb8623ec3a4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:55 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:23:55 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:56 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd" returned: 0 in 0.920s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=114,cinder:INSERT=34,cinder:SELECT=107,cinder:DELETE=8 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=89,cinder:UPDATE=122,cinder:DELETE=10,cinder:INSERT=33 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Attempting download of cc681eb4-3907-4740-a2c7-1541678646a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc681eb4-3907-4740-a2c7-1541678646a2', 'metadata': {}}])) to volume f451fb8a-fd66-48c2-9ab3-39149a8f71dd. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[036194bd-9df1-4a7d-9a70-0998be104f98]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc681eb4-3907-4740-a2c7-1541678646a2_rircmlfo {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:56 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc681eb4-3907-4740-a2c7-1541678646a2_rircmlfo Jul 09 15:23:56 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:56 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.122s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:23:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Deleted volume successfully. Jul 09 15:23:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-68d9de9e-3a71-4245-bf26-0e9909ed33ac tempest-CinderUnicodeTest-1233431988 None] Lock "cinder-4ec85088-3053-4b6c-8379-9ec065beb2c1-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:23:57 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc681eb4-3907-4740-a2c7-1541678646a2_rircmlfo" returned: 0 in 1.312s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc681eb4-3907-4740-a2c7-1541678646a2_rircmlfo {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:58 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc681eb4-3907-4740-a2c7-1541678646a2_rircmlfo Jul 09 15:23:58 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:58 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc681eb4-3907-4740-a2c7-1541678646a2_rircmlfo" returned: 1 in 0.960s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc681eb4-3907-4740-a2c7-1541678646a2_rircmlfo' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:23:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65fa585-be89-4037-9ab1-c0d596f5d5d4]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:23:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:58 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD Jul 09 15:23:58 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:23:59 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Jul 09 15:23:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD" returned: 0 in 0.913s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:23:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:23:59 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD Jul 09 15:23:59 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:00 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD" returned: 1 in 0.952s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:24:00 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] cc681eb4-3907-4740-a2c7-1541678646a2 was raw, converting to raw {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:24:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:00 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd Jul 09 15:24:00 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:01 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd" returned: 0 in 1.206s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:01 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc681eb4-3907-4740-a2c7-1541678646a2_fm7hjd0mdevstack@QuobyteHD, size 0.00 MB, duration 1.21 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:24:01 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 15:24:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:01 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd 1G Jul 09 15:24:01 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:02 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd 1G" returned: 0 in 0.898s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0a2098-e38b-4227-a776-318caac97486]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:03 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd Jul 09 15:24:03 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:03 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd" returned: 0 in 1.077s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:04 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd Jul 09 15:24:04 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cea58638-3589-41b1-bca0-97080972ebfd req-f1233ef9-fcbb-4f7a-8b7b-d8afc6d9373d tempest-TestStampPattern-1299061683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cea58638-3589-41b1-bca0-97080972ebfd req-f1233ef9-fcbb-4f7a-8b7b-d8afc6d9373d tempest-TestStampPattern-1299061683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9df6e14-c91b-4045-90cb-9cdd33cb9e0d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-cea58638-3589-41b1-bca0-97080972ebfd req-f1233ef9-fcbb-4f7a-8b7b-d8afc6d9373d tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:04 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b Jul 09 15:24:04 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:04 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd" returned: 1 in 0.936s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Downloaded image cc681eb4-3907-4740-a2c7-1541678646a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc681eb4-3907-4740-a2c7-1541678646a2', 'metadata': {}}])) to volume f451fb8a-fd66-48c2-9ab3-39149a8f71dd successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Temporary image cc681eb4-3907-4740-a2c7-1541678646a2 for user b893f8ac05fa4108aa44a7d52321a970 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Marking volume f451fb8a-fd66-48c2-9ab3-39149a8f71dd as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Copying metadata from image cc681eb4-3907-4740-a2c7-1541678646a2 to f451fb8a-fd66-48c2-9ab3-39149a8f71dd. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:24:04 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Creating volume glance metadata for volume f451fb8a-fd66-48c2-9ab3-39149a8f71dd backed by image cc681eb4-3907-4740-a2c7-1541678646a2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cc681eb4-3907-4740-a2c7-1541678646a2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '80ab3dde37866c40e14e3473db2efd48', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7d19ce-4370-4528-aea4-24bc401895c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd', 'volume_size': 1, 'image_id': 'cc681eb4-3907-4740-a2c7-1541678646a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc681eb4-3907-4740-a2c7-1541678646a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80ab3dde37866c40e14e3473db2efd48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd63bdf7d0da04d78aee8670b7238a87c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5be6dd6c819bf811bb8cc98e4ae24acd5a8655342d51325785c18f55fb9c282c82ec14a8c7a89371985bc3d5cb2ae60ed4b1dc49c10a0e8fba93f6887117166a', 'id': 'cc681eb4-3907-4740-a2c7-1541678646a2', 'created_at': datetime.datetime(2026, 7, 9, 13, 23, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 23, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc681eb4-3907-4740-a2c7-1541678646a2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4dd03d-5bf1-4b2d-a0fa-b8089f33823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Volume volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd (f451fb8a-fd66-48c2-9ab3-39149a8f71dd): created successfully Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4dd03d-5bf1-4b2d-a0fa-b8089f33823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Flow 'volume_create_manager' (37b1bcfc-2c30-4b1d-bcc1-55e305877d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a261aa14-8db4-4b73-acac-093b37d8a106 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Created volume successfully. Jul 09 15:24:05 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-cea58638-3589-41b1-bca0-97080972ebfd req-f1233ef9-fcbb-4f7a-8b7b-d8afc6d9373d tempest-TestStampPattern-1299061683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" returned: 0 in 0.960s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-cea58638-3589-41b1-bca0-97080972ebfd req-f1233ef9-fcbb-4f7a-8b7b-d8afc6d9373d tempest-TestStampPattern-1299061683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-cea58638-3589-41b1-bca0-97080972ebfd req-f1233ef9-fcbb-4f7a-8b7b-d8afc6d9373d tempest-TestStampPattern-1299061683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dd5df15-2d91-4d92-af2c-a64a65cc4ba6', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:24:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-cea58638-3589-41b1-bca0-97080972ebfd req-f1233ef9-fcbb-4f7a-8b7b-d8afc6d9373d tempest-TestStampPattern-1299061683 None] attachment_update completed successfully. Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Acquiring lock "cinder-f451fb8a-fd66-48c2-9ab3-39149a8f71dd-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Lock "cinder-f451fb8a-fd66-48c2-9ab3-39149a8f71dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Acquiring lock "cinder-quobyte-f451fb8a-fd66-48c2-9ab3-39149a8f71dd" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Lock "cinder-quobyte-f451fb8a-fd66-48c2-9ab3-39149a8f71dd" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c3e20d-5a61-48e4-a982-a456edb96e65]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:06 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd Jul 09 15:24:06 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:06 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd" returned: 0 in 0.941s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:07 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd Jul 09 15:24:07 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Flow 'volume_create_manager' (00507c92-d05e-4ba0-8fe8-de8fd15dfb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1816d3-dc12-48fe-9df8-75f8237752d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1816d3-dc12-48fe-9df8-75f8237752d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808860980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea73ba6-db13-4dd0-a50f-54f4288dc0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cdee9983854572896964bc07d81ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:07Z,use_quota=True,user_id='1c56283db4a14fb28f6e35880a041b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5da65a9-a271-46d1-996a-d90c8006b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5da65a9-a271-46d1-996a-d90c8006b474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859c93fd-3779-455e-a857-5471bf968978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859c93fd-3779-455e-a857-5471bf968978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea73ba6-db13-4dd0-a50f-54f4288dc0ed', 'volume_name': 'volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86113ad-f3bf-464b-990f-61ced02421ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86113ad-f3bf-464b-990f-61ced02421ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65398fb1-d53c-498a-84c1-68cdd49c3d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Volume aea73ba6-db13-4dd0-a50f-54f4288dc0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed', 'volume_size': 1} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1808860980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea73ba6-db13-4dd0-a50f-54f4288dc0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cdee9983854572896964bc07d81ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:07Z,use_quota=True,user_id='1c56283db4a14fb28f6e35880a041b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Creating volume aea73ba6-db13-4dd0-a50f-54f4288dc0ed {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:07 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:07 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed 1073741824 Jul 09 15:24:07 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:07 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd" returned: 1 in 0.915s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:24:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:07 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd Jul 09 15:24:07 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:08 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed 1073741824" returned: 0 in 0.988s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:08 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed Jul 09 15:24:08 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:08 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f451fb8a-fd66-48c2-9ab3-39149a8f71dd" returned: 0 in 0.717s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Lock "cinder-quobyte-f451fb8a-fd66-48c2-9ab3-39149a8f71dd" released by "delete_volume" :: held 2.683s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:08 devstack cinder-volume[86916]: WARNING cinder.quota [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:24:08 devstack cinder-volume[86916]: WARNING cinder.quota [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Created reservations ['5cdcc569-2925-4615-a410-283ad5a82fcb', '326e6b63-8e88-40b4-9475-a1e589a92c60', 'd45863be-f8d2-4d9d-9ae9-686544aef8a5', '4c6a8963-3d77-4aeb-a54f-ad59108b830f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:08 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:24:08 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:09 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed" returned: 0 in 0.843s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65398fb1-d53c-498a-84c1-68cdd49c3d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12ffc55-2c13-4b5a-a0e4-15fe925751da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Volume volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed (aea73ba6-db13-4dd0-a50f-54f4288dc0ed): created successfully Jul 09 15:24:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12ffc55-2c13-4b5a-a0e4-15fe925751da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Flow 'volume_create_manager' (00507c92-d05e-4ba0-8fe8-de8fd15dfb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-732f32bc-03bb-42e3-a238-c56a372eed88 tempest-ProjectReaderTests-1294985027 None] Created volume successfully. Jul 09 15:24:09 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.794s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:09 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Deleted volume successfully. Jul 09 15:24:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c3e9396e-2c90-4c40-b92a-41891d84e3b3 tempest-VolumeAndVolumeTypeFromImageTest-634343415 None] Lock "cinder-f451fb8a-fd66-48c2-9ab3-39149a8f71dd-delete_volume" released by "delete_volume" :: held 3.744s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Acquiring lock "cinder-aea73ba6-db13-4dd0-a50f-54f4288dc0ed-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Lock "cinder-aea73ba6-db13-4dd0-a50f-54f4288dc0ed-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Acquiring lock "cinder-quobyte-aea73ba6-db13-4dd0-a50f-54f4288dc0ed" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Lock "cinder-quobyte-aea73ba6-db13-4dd0-a50f-54f4288dc0ed" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0428a03e-30a2-46fd-b8af-9d75d3a3b8df]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:11 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed Jul 09 15:24:11 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:12 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed" returned: 0 in 0.964s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:12 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed Jul 09 15:24:12 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:13 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-aea73ba6-db13-4dd0-a50f-54f4288dc0ed" returned: 0 in 0.890s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Lock "cinder-quobyte-aea73ba6-db13-4dd0-a50f-54f4288dc0ed" released by "delete_volume" :: held 1.926s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Created reservations ['b149c36e-0af8-411e-a06a-73fab0e8cb75', 'f567310d-514b-4f01-9d76-6f1e8b073027', '357682b3-96b4-417d-8489-2a579735ffee', '6ab96bcf-4eed-47d0-8e02-4bbc433f27df'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:13 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:24:13 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Flow 'volume_create_manager' (bf4447dc-7e97-4de7-a87a-0fa39357401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c02c98b-ca71-44a9-b43b-4e1cebe2df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c02c98b-ca71-44a9-b43b-4e1cebe2df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671691188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cdee9983854572896964bc07d81ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:14Z,use_quota=True,user_id='1c56283db4a14fb28f6e35880a041b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c150e7-303a-4c37-b405-3faec1992699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c150e7-303a-4c37-b405-3faec1992699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e400fd8-dad2-45b3-80b4-e46831e27648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e400fd8-dad2-45b3-80b4-e46831e27648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0', 'volume_name': 'volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92d1db2-c527-4657-999f-4d3105d7f64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92d1db2-c527-4657-999f-4d3105d7f64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e30664-162a-4e6c-9fa9-c459debd3a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Volume 40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0', 'volume_size': 1} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671691188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cdee9983854572896964bc07d81ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:14Z,use_quota=True,user_id='1c56283db4a14fb28f6e35880a041b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Creating volume 40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:14 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 1073741824 Jul 09 15:24:14 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:14 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.266s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Deleted volume successfully. Jul 09 15:24:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49146b7-b27b-42ef-8380-ba10acb95d79 tempest-ProjectReaderTests-1294985027 None] Lock "cinder-aea73ba6-db13-4dd0-a50f-54f4288dc0ed-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:15 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 1073741824" returned: 0 in 1.248s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:15 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 Jul 09 15:24:15 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-79543658-e01d-47bb-a612-d5f8c686bde7 req-340980e5-46b6-49b7-9f4e-851c0b4390c7 tempest-TestStampPattern-1299061683 None] Terminate volume connection completed successfully. Jul 09 15:24:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-79543658-e01d-47bb-a612-d5f8c686bde7 req-340980e5-46b6-49b7-9f4e-851c0b4390c7 tempest-TestStampPattern-1299061683 None] Deleting attachment 3dd5df15-2d91-4d92-af2c-a64a65cc4ba6. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:24:16 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0" returned: 0 in 0.861s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e30664-162a-4e6c-9fa9-c459debd3a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb56120a-ba04-4d6e-ac89-454c3bccd621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Volume volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 (40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0): created successfully Jul 09 15:24:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb56120a-ba04-4d6e-ac89-454c3bccd621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Flow 'volume_create_manager' (bf4447dc-7e97-4de7-a87a-0fa39357401b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e3dea63c-e1f0-437c-ba7e-ffed40cc7592 tempest-ProjectReaderTests-1294985027 None] Created volume successfully. Jul 09 15:24:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Acquiring lock "cinder-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Lock "cinder-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Acquiring lock "cinder-quobyte-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Lock "cinder-quobyte-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8d8247-4df1-4d1a-a313-2fa4170ea40b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:17 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 Jul 09 15:24:17 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Creating offline snapshot d6e817e2-c1a8-42b6-8174-a1f18cac8dfd of volume 4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:24:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02a56f8-ab85-457c-b514-093944b79409]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:18 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0" returned: 0 in 0.927s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:18 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0 Jul 09 15:24:18 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:18 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b Jul 09 15:24:18 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:19 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0" returned: 0 in 0.870s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Lock "cinder-quobyte-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0" released by "delete_volume" :: held 1.855s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:19 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" returned: 0 in 1.015s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:19 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd 1G Jul 09 15:24:19 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Created reservations ['7a55f8e0-9c7e-4a9b-85e4-34090b714928', '8bb51e97-1476-4b4f-b795-3e237bf646ab', '9d2a18b9-651b-433d-b38a-f9d9d07eb736', '66e33e7a-8366-416b-a8fd-0e435de10450'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:19 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:24:19 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:20 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Flow 'volume_create_manager' (478c1d15-9b7f-4b6e-95ab-8e8bd55ed129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac61957-f618-47bd-b949-a577cb2a0885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:20 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.967s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd 1G" returned: 0 in 1.131s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Deleted volume successfully. Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac61957-f618-47bd-b949-a577cb2a0885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-767702312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daeb6ddb-f77b-4936-b447-60ff4306ce87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cdee9983854572896964bc07d81ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:20Z,use_quota=True,user_id='1c56283db4a14fb28f6e35880a041b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b179b4-8b41-45b2-af48-20f88e4a8fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b179b4-8b41-45b2-af48-20f88e4a8fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9928a7-6ae7-4062-ab8d-bc14628a7bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:20 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd Jul 09 15:24:20 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9928a7-6ae7-4062-ab8d-bc14628a7bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daeb6ddb-f77b-4936-b447-60ff4306ce87', 'volume_name': 'volume-daeb6ddb-f77b-4936-b447-60ff4306ce87', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87128ce8-9fcf-4fff-a433-704451597549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87128ce8-9fcf-4fff-a433-704451597549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c588d09-4e24-4abd-bd93-f26c58fddb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Volume daeb6ddb-f77b-4936-b447-60ff4306ce87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daeb6ddb-f77b-4936-b447-60ff4306ce87', 'volume_size': 1} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-584c0a56-9cd9-42aa-a9df-1e43f25afc63 tempest-ProjectReaderTests-1294985027 None] Lock "cinder-40d5a2dc-c07d-45d0-ad1e-6450c78c7cc0-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Flow 'volume_create_manager' (443e535f-837f-43c1-8653-a73ff46b190f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cafc08b-45ad-4b13-b842-88b636b45fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cafc08b-45ad-4b13-b842-88b636b45fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1302175662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f290a6b-a229-412b-8ec5-8b3c87347369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906939731f32475e9415f39c6e656360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:21Z,use_quota=True,user_id='4d888ff2aff5488bb2d301829292e655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4675cc15-b607-44c2-b7a1-d2fe181a7194),volume_type_id=4675cc15-b607-44c2-b7a1-d2fe181a7194)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fec0ff-d630-4eba-bf64-173ae142fd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fec0ff-d630-4eba-bf64-173ae142fd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a119eab0-53ed-4124-8856-0d55aab23a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a119eab0-53ed-4124-8856-0d55aab23a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f290a6b-a229-412b-8ec5-8b3c87347369', 'volume_name': 'volume-8f290a6b-a229-412b-8ec5-8b3c87347369', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb88065d-3d13-4815-9a11-4f5a1ea0fa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb88065d-3d13-4815-9a11-4f5a1ea0fa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fd6d1d-6601-46cf-b4a5-db6465bc00d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:20 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Volume 8f290a6b-a229-412b-8ec5-8b3c87347369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f290a6b-a229-412b-8ec5-8b3c87347369', 'volume_size': 1} Jul 09 15:24:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Flow 'volume_create_manager' (cde60b6d-1dcc-4c44-b201-8669c3ab2e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2c5c44-ba42-44c7-9cb3-c088e205bdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2c5c44-ba42-44c7-9cb3-c088e205bdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1972460121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54209dfc-9b93-41da-8fdb-46dd60c935e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906939731f32475e9415f39c6e656360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:21Z,use_quota=True,user_id='4d888ff2aff5488bb2d301829292e655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab3b0830-f2ca-4728-aede-cd99967a3d16),volume_type_id=ab3b0830-f2ca-4728-aede-cd99967a3d16)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7953707-3d22-465c-a05f-aee0dcc4156b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7953707-3d22-465c-a05f-aee0dcc4156b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f37b66c-9258-4e69-b3e2-1ce41d571d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f37b66c-9258-4e69-b3e2-1ce41d571d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54209dfc-9b93-41da-8fdb-46dd60c935e7', 'volume_name': 'volume-54209dfc-9b93-41da-8fdb-46dd60c935e7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c42894-e729-4eeb-9895-a0356bff4ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c42894-e729-4eeb-9895-a0356bff4ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969f5c04-cf5f-4a68-839f-0dc5d60fa812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Volume 54209dfc-9b93-41da-8fdb-46dd60c935e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54209dfc-9b93-41da-8fdb-46dd60c935e7', 'volume_size': 1} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:21 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd" returned: 0 in 0.922s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:21 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd is being set with open permissions: ugo+rw Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:21 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd Jul 09 15:24:21 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Flow 'volume_create_manager' (b837ce2e-2972-49e5-9bde-451e9013fe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1372096d-c960-4790-8992-771565912b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1372096d-c960-4790-8992-771565912b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1726977946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6466b54c-e12f-466c-82c6-ef02f0fc9abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906939731f32475e9415f39c6e656360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:22Z,use_quota=True,user_id='4d888ff2aff5488bb2d301829292e655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36428e76-e27c-440f-a80b-e245aa1b9468),volume_type_id=36428e76-e27c-440f-a80b-e245aa1b9468)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f92e2d4-3796-4652-972e-65af5b00405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f92e2d4-3796-4652-972e-65af5b00405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43869c46-3715-479e-a04a-4725987c6546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:21 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:24:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43869c46-3715-479e-a04a-4725987c6546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6466b54c-e12f-466c-82c6-ef02f0fc9abf', 'volume_name': 'volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf', 'volume_size': 1, 'image_id': 'f94b813f-8806-4c6f-825c-3188edb952d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f94b813f-8806-4c6f-825c-3188edb952d4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2133471485', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '906939731f32475e9415f39c6e656360', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f94b813f-8806-4c6f-825c-3188edb952d4', 'created_at': datetime.datetime(2026, 7, 9, 13, 24, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 24, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f94b813f-8806-4c6f-825c-3188edb952d4/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bff175-2c07-41d4-ada7-1f0eedc7100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bff175-2c07-41d4-ada7-1f0eedc7100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cb0e54-1ed8-4ba7-afd5-9e65ea8bae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Volume 6466b54c-e12f-466c-82c6-ef02f0fc9abf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf', 'volume_size': 1, 'image_id': 'f94b813f-8806-4c6f-825c-3188edb952d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f94b813f-8806-4c6f-825c-3188edb952d4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2133471485', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '906939731f32475e9415f39c6e656360', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f94b813f-8806-4c6f-825c-3188edb952d4', 'created_at': datetime.datetime(2026, 7, 9, 13, 24, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 24, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f94b813f-8806-4c6f-825c-3188edb952d4/file', 'properties': {}}, 'image_service': } Jul 09 15:24:22 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Trying to clone 6466b54c-e12f-466c-82c6-ef02f0fc9abf from image f94b813f-8806-4c6f-825c-3188edb952d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f94b813f-8806-4c6f-825c-3188edb952d4', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:24:22 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd" returned: 0 in 0.775s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:22 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.info Jul 09 15:24:22 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:23 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.info" returned: 0 in 0.899s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:23 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.info is being set with open permissions: ugo+rw Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:23 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.info Jul 09 15:24:23 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:23 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.info" returned: 0 in 0.700s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.542s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.280s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-767702312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daeb6ddb-f77b-4936-b447-60ff4306ce87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cdee9983854572896964bc07d81ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:20Z,use_quota=True,user_id='1c56283db4a14fb28f6e35880a041b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Creating volume daeb6ddb-f77b-4936-b447-60ff4306ce87 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:24:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:23 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87 1073741824 Jul 09 15:24:23 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ebcfddd5-4224-4863-a21f-c618e32e516c tempest-TestStampPattern-1299061683 None] Create snapshot completed successfully Jul 09 15:24:24 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87 1073741824" returned: 0 in 0.852s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:24 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87 Jul 09 15:24:24 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:25 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87" returned: 0 in 0.683s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.698s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1302175662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f290a6b-a229-412b-8ec5-8b3c87347369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906939731f32475e9415f39c6e656360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:21Z,use_quota=True,user_id='4d888ff2aff5488bb2d301829292e655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4675cc15-b607-44c2-b7a1-d2fe181a7194),volume_type_id=4675cc15-b607-44c2-b7a1-d2fe181a7194)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Creating volume 8f290a6b-a229-412b-8ec5-8b3c87347369 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:25 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c588d09-4e24-4abd-bd93-f26c58fddb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daeb6ddb-f77b-4936-b447-60ff4306ce87', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:25 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 1073741824 Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a1edd9-79fb-43ff-8753-fa55a21baf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:25 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD, size 20.69 MB, duration 3.34 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:24:25 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Image download 20.69 MB at 6.20 MB/s Jul 09 15:24:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Volume volume-daeb6ddb-f77b-4936-b447-60ff4306ce87 (daeb6ddb-f77b-4936-b447-60ff4306ce87): created successfully Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a1edd9-79fb-43ff-8753-fa55a21baf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Flow 'volume_create_manager' (478c1d15-9b7f-4b6e-95ab-8e8bd55ed129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-626501e8-522c-4c9e-b20a-8eec2b60233a tempest-ProjectReaderTests-1294985027 None] Created volume successfully. Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[115bcf2d-7fd3-4096-b060-d486e59b06cc]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:25 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD Jul 09 15:24:25 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:26 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 1073741824" returned: 0 in 0.854s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:26 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 Jul 09 15:24:26 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:26 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD" returned: 0 in 0.789s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Temporary image f94b813f-8806-4c6f-825c-3188edb952d4 is fetched for user 4d888ff2aff5488bb2d301829292e655. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2dcfd8-198c-4dca-a542-03e125a26ea6]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:26 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD Jul 09 15:24:26 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Acquiring lock "cinder-daeb6ddb-f77b-4936-b447-60ff4306ce87-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Lock "cinder-daeb6ddb-f77b-4936-b447-60ff4306ce87-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Acquiring lock "cinder-quobyte-daeb6ddb-f77b-4936-b447-60ff4306ce87" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Lock "cinder-quobyte-daeb6ddb-f77b-4936-b447-60ff4306ce87" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0093d06f-6d26-4b6d-8d6b-7c8b91b87c82]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:27 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87 Jul 09 15:24:27 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:27 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369" returned: 0 in 0.734s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.853s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1972460121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54209dfc-9b93-41da-8fdb-46dd60c935e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906939731f32475e9415f39c6e656360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:21Z,use_quota=True,user_id='4d888ff2aff5488bb2d301829292e655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab3b0830-f2ca-4728-aede-cd99967a3d16),volume_type_id=ab3b0830-f2ca-4728-aede-cd99967a3d16)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Creating volume 54209dfc-9b93-41da-8fdb-46dd60c935e7 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:27 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:27 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 1073741824 Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fd6d1d-6601-46cf-b4a5-db6465bc00d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f290a6b-a229-412b-8ec5-8b3c87347369', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:27 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e452ee-0eb2-4c17-b4f5-52e4426fe4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:27 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Volume volume-8f290a6b-a229-412b-8ec5-8b3c87347369 (8f290a6b-a229-412b-8ec5-8b3c87347369): created successfully Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e452ee-0eb2-4c17-b4f5-52e4426fe4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Flow 'volume_create_manager' (443e535f-837f-43c1-8653-a73ff46b190f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-70a36b74-336a-4333-aac2-d13b302a96ab tempest-TestInstancesWithCinderVolumes-135017459 None] Created volume successfully. Jul 09 15:24:27 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD" returned: 0 in 0.893s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:27 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87" returned: 0 in 0.863s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:27 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87 Jul 09 15:24:27 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:28 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 1073741824" returned: 0 in 0.925s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:28 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 Jul 09 15:24:28 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:28 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-daeb6ddb-f77b-4936-b447-60ff4306ce87" returned: 0 in 0.680s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Lock "cinder-quobyte-daeb6ddb-f77b-4936-b447-60ff4306ce87" released by "delete_volume" :: held 1.599s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Created reservations ['93ca27da-57a4-4aaa-9d98-e9803eabf158', '632f32ef-9976-4c27-8252-85f0c31c7f78', '8733111e-f6bd-4ff1-9f0f-ca570af23c2d', 'ad675e9f-d70b-48f7-9221-41dc3f2606f0'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:28 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:24:28 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:28 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7" returned: 0 in 0.684s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.403s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1726977946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6466b54c-e12f-466c-82c6-ef02f0fc9abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906939731f32475e9415f39c6e656360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:22Z,use_quota=True,user_id='4d888ff2aff5488bb2d301829292e655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36428e76-e27c-440f-a80b-e245aa1b9468),volume_type_id=36428e76-e27c-440f-a80b-e245aa1b9468)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Creating volume 6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:28 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:28 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf 1073741824 Jul 09 15:24:28 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969f5c04-cf5f-4a68-839f-0dc5d60fa812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54209dfc-9b93-41da-8fdb-46dd60c935e7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49298e4-0882-4c55-9112-e9464a44e1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Volume volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 (54209dfc-9b93-41da-8fdb-46dd60c935e7): created successfully Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49298e4-0882-4c55-9112-e9464a44e1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Flow 'volume_create_manager' (cde60b6d-1dcc-4c44-b201-8669c3ab2e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-33a27fb0-8027-4a5e-8b96-8966dd6ee402 tempest-TestInstancesWithCinderVolumes-135017459 None] Created volume successfully. Jul 09 15:24:29 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.756s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Deleted volume successfully. Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-84b595bd-3fda-457f-b9b6-736183b449fc tempest-ProjectReaderTests-1294985027 None] Lock "cinder-daeb6ddb-f77b-4936-b447-60ff4306ce87-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Flow 'volume_create_manager' (03b4396e-c752-476c-bcf2-ead97eaf9474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799bf14d-c522-4776-a835-4c724c44408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799bf14d-c522-4776-a835-4c724c44408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249845116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3627533-3aeb-48ba-9dd1-3ec8e41d0466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cdee9983854572896964bc07d81ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:30Z,use_quota=True,user_id='1c56283db4a14fb28f6e35880a041b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703b0492-f854-4ab9-9d7e-520146110adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703b0492-f854-4ab9-9d7e-520146110adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2205c762-583b-4052-874f-3564033525b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2205c762-583b-4052-874f-3564033525b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3627533-3aeb-48ba-9dd1-3ec8e41d0466', 'volume_name': 'volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3677d6e9-1811-46fa-a075-f196989fa138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3677d6e9-1811-46fa-a075-f196989fa138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdd2a49-cadc-4f30-af1b-8a4b34d6872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Volume f3627533-3aeb-48ba-9dd1-3ec8e41d0466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466', 'volume_size': 1} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:29 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf 1073741824" returned: 0 in 1.020s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:29 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf Jul 09 15:24:29 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:30 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf" returned: 0 in 0.675s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.720s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249845116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3627533-3aeb-48ba-9dd1-3ec8e41d0466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cdee9983854572896964bc07d81ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:30Z,use_quota=True,user_id='1c56283db4a14fb28f6e35880a041b74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Creating volume f3627533-3aeb-48ba-9dd1-3ec8e41d0466 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:30 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466 1073741824 Jul 09 15:24:30 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Attempting download of f94b813f-8806-4c6f-825c-3188edb952d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f94b813f-8806-4c6f-825c-3188edb952d4', 'metadata': {}}])) to volume 6466b54c-e12f-466c-82c6-ef02f0fc9abf. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b8339d-1520-43a6-9406-910a40a7025b]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f94b813f-8806-4c6f-825c-3188edb952d4_tkvxapum {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:30 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f94b813f-8806-4c6f-825c-3188edb952d4_tkvxapum Jul 09 15:24:30 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:31 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466 1073741824" returned: 0 in 0.880s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:31 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f94b813f-8806-4c6f-825c-3188edb952d4_tkvxapum" returned: 0 in 0.795s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f94b813f-8806-4c6f-825c-3188edb952d4_tkvxapum {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:31 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466 Jul 09 15:24:31 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:31 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f94b813f-8806-4c6f-825c-3188edb952d4_tkvxapum Jul 09 15:24:31 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:32 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466" returned: 0 in 0.717s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:32 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdd2a49-cadc-4f30-af1b-8a4b34d6872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d81798-fdb6-4706-9982-a89ea5c2b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f94b813f-8806-4c6f-825c-3188edb952d4_tkvxapum" returned: 1 in 0.805s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f94b813f-8806-4c6f-825c-3188edb952d4_tkvxapum' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1f8891-d75f-4a5e-9999-4cd096610512]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Volume volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466 (f3627533-3aeb-48ba-9dd1-3ec8e41d0466): created successfully Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d81798-fdb6-4706-9982-a89ea5c2b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Flow 'volume_create_manager' (03b4396e-c752-476c-bcf2-ead97eaf9474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ea993338-1478-4ebf-a677-7f3f0b836aad tempest-ProjectReaderTests-1294985027 None] Created volume successfully. Jul 09 15:24:32 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD Jul 09 15:24:32 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Acquiring lock "cinder-f3627533-3aeb-48ba-9dd1-3ec8e41d0466-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Lock "cinder-f3627533-3aeb-48ba-9dd1-3ec8e41d0466-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Acquiring lock "cinder-quobyte-f3627533-3aeb-48ba-9dd1-3ec8e41d0466" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Lock "cinder-quobyte-f3627533-3aeb-48ba-9dd1-3ec8e41d0466" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8fe637-d369-4306-8937-3fa5bcb504b0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:33 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD" returned: 0 in 0.822s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:33 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] f94b813f-8806-4c6f-825c-3188edb952d4 was qcow2, converting to raw {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:24:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:33 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf Jul 09 15:24:33 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466 Jul 09 15:24:33 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:33 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:33 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466" returned: 0 in 0.871s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:33 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466 Jul 09 15:24:33 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:34 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-f3627533-3aeb-48ba-9dd1-3ec8e41d0466" returned: 0 in 0.731s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Lock "cinder-quobyte-f3627533-3aeb-48ba-9dd1-3ec8e41d0466" released by "delete_volume" :: held 1.659s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Created reservations ['f470498d-6b5f-45c9-8ca6-3e5c7982a41e', 'd7431619-cd59-4ac7-b9a8-933b29e7ff08', 'b4eac7cf-e68a-471d-b737-6f99bc989779', '8d37ae4d-a37c-4baa-8c0f-77b8608167fc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:34 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:24:34 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Flow 'volume_create_manager' (05dfce8e-c67f-416a-9697-dac0750c8f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e149d31-c9dd-4a12-9286-c7f2801768ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e149d31-c9dd-4a12-9286-c7f2801768ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1094302830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868ffc2f-bbb7-459a-a4e1-e0cea563b530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='423ae806886a4d2eaeffcae1c993ddcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d6e817e2-c1a8-42b6-8174-a1f18cac8dfd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:24:35Z,use_quota=True,user_id='cf941dfa51ae4e509aa407cc19fe90a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c159c435-56d7-4bd4-b6c5-1a268add2385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c159c435-56d7-4bd4-b6c5-1a268add2385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a98fbe-e6e0-4a74-97a1-06f64dbb7588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a98fbe-e6e0-4a74-97a1-06f64dbb7588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '868ffc2f-bbb7-459a-a4e1-e0cea563b530', 'volume_name': 'volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530', 'volume_size': 1, 'snapshot_id': 'd6e817e2-c1a8-42b6-8174-a1f18cac8dfd'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac901ad1-010d-4899-b647-9343558b40fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac901ad1-010d-4899-b647-9343558b40fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c327fcb-3c18-4c07-9592-567b4d97feba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Volume 868ffc2f-bbb7-459a-a4e1-e0cea563b530: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530', 'volume_size': 1, 'snapshot_id': 'd6e817e2-c1a8-42b6-8174-a1f18cac8dfd'} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Acquiring lock "cinder-quobyte-d6e817e2-c1a8-42b6-8174-a1f18cac8dfd-868ffc2f-bbb7-459a-a4e1-e0cea563b530" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-d6e817e2-c1a8-42b6-8174-a1f18cac8dfd-868ffc2f-bbb7-459a-a4e1-e0cea563b530" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Creating volume 868ffc2f-bbb7-459a-a4e1-e0cea563b530 from snapshot d6e817e2-c1a8-42b6-8174-a1f18cac8dfd {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Acquiring lock "cinder-quobyte-868ffc2f-bbb7-459a-a4e1-e0cea563b530" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-868ffc2f-bbb7-459a-a4e1-e0cea563b530" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:24:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] snapshot: d6e817e2-c1a8-42b6-8174-a1f18cac8dfd, volume: 868ffc2f-bbb7-459a-a4e1-e0cea563b530, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e609bc71-5cb1-4bf1-96c2-2490cb22a37f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:35 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd Jul 09 15:24:35 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:35 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf" returned: 0 in 2.201s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f94b813f-8806-4c6f-825c-3188edb952d4_av2iw8d_devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:24:35 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Converted 112.00 MB image at 50.86 MB/s Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:35 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf 1G Jul 09 15:24:35 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:35 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.141s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Deleted volume successfully. Jul 09 15:24:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a502cf94-f48a-4124-ba4c-fbe35c55705a tempest-ProjectReaderTests-1294985027 None] Lock "cinder-f3627533-3aeb-48ba-9dd1-3ec8e41d0466-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:36 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd" returned: 0 in 0.997s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:24:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:24:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:24:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4499d40d-856b-465b-85fe-ea3256fb7420]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:36 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf 1G" returned: 0 in 0.970s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:36 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b Jul 09 15:24:36 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bca5ed4-7643-4a4a-b018-3f902659e33f]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:36 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf Jul 09 15:24:36 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:37 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" returned: 0 in 1.120s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:37 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:24:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:37 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf" returned: 0 in 0.992s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:37 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 Jul 09 15:24:37 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:37 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf Jul 09 15:24:37 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:38 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf" returned: 1 in 0.916s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Downloaded image f94b813f-8806-4c6f-825c-3188edb952d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f94b813f-8806-4c6f-825c-3188edb952d4', 'metadata': {}}])) to volume 6466b54c-e12f-466c-82c6-ef02f0fc9abf successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Temporary image f94b813f-8806-4c6f-825c-3188edb952d4 for user 4d888ff2aff5488bb2d301829292e655 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Marking volume 6466b54c-e12f-466c-82c6-ef02f0fc9abf as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Copying metadata from image f94b813f-8806-4c6f-825c-3188edb952d4 to 6466b54c-e12f-466c-82c6-ef02f0fc9abf. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Creating volume glance metadata for volume 6466b54c-e12f-466c-82c6-ef02f0fc9abf backed by image f94b813f-8806-4c6f-825c-3188edb952d4 with: {'image_id': 'f94b813f-8806-4c6f-825c-3188edb952d4', 'image_name': 'tempest-scenario-img--2133471485', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cb0e54-1ed8-4ba7-afd5-9e65ea8bae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf', 'volume_size': 1, 'image_id': 'f94b813f-8806-4c6f-825c-3188edb952d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f94b813f-8806-4c6f-825c-3188edb952d4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2133471485', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '906939731f32475e9415f39c6e656360', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f94b813f-8806-4c6f-825c-3188edb952d4', 'created_at': datetime.datetime(2026, 7, 9, 13, 24, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 24, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f94b813f-8806-4c6f-825c-3188edb952d4/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c633e3-beae-4815-9acb-9fe91b222404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:38 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Volume volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf (6466b54c-e12f-466c-82c6-ef02f0fc9abf): created successfully Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c633e3-beae-4815-9acb-9fe91b222404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:38 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Flow 'volume_create_manager' (b837ce2e-2972-49e5-9bde-451e9013fe1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:38 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5d71f2fa-3591-446c-aa9b-f97f2e47b123 tempest-TestInstancesWithCinderVolumes-135017459 None] Created volume successfully. Jul 09 15:24:42 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530" returned: 0 in 5.541s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6567964b-39e9-4e30-a5d3-a37b2d6ecc48]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:42 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b Jul 09 15:24:42 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:43 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" returned: 0 in 1.049s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:43 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:24:43 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Converted 1024.00 MB image at 184.77 MB/s Jul 09 15:24:43 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 is being set with open permissions: ugo+rw Jul 09 15:24:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:43 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 Jul 09 15:24:43 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:44 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530" returned: 0 in 0.901s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-868ffc2f-bbb7-459a-a4e1-e0cea563b530" released by "_copy_volume_from_snapshot" :: held 9.782s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-d6e817e2-c1a8-42b6-8174-a1f18cac8dfd-868ffc2f-bbb7-459a-a4e1-e0cea563b530" released by "_create_volume_from_snapshot" :: held 9.817s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:24:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.833s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c327fcb-3c18-4c07-9592-567b4d97feba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530', 'volume_size': 1, 'snapshot_id': 'd6e817e2-c1a8-42b6-8174-a1f18cac8dfd'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dd88b3-5ee4-4b94-9698-bfcc0b98d99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:24:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Volume volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 (868ffc2f-bbb7-459a-a4e1-e0cea563b530): created successfully Jul 09 15:24:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dd88b3-5ee4-4b94-9698-bfcc0b98d99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:24:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Flow 'volume_create_manager' (05dfce8e-c67f-416a-9697-dac0750c8f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:24:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-26434794-625b-4b2e-81f7-fc548362ce82 tempest-TestStampPattern-1299061683 None] Created volume successfully. Jul 09 15:24:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:24:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:24:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:24:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:47 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:24:47 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:48 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.866s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:24:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:24:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:24:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:24:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-b702e4f5-c020-4049-8466-7ee2f845558b req-57f0ad75-b678-4903-8729-a78ea3b35128 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:24:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-b702e4f5-c020-4049-8466-7ee2f845558b req-57f0ad75-b678-4903-8729-a78ea3b35128 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:24:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ebbf80-4463-4bc7-bcdf-ee32b0895449]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:24:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b702e4f5-c020-4049-8466-7ee2f845558b req-57f0ad75-b678-4903-8729-a78ea3b35128 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:48 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf Jul 09 15:24:48 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:49 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b702e4f5-c020-4049-8466-7ee2f845558b req-57f0ad75-b678-4903-8729-a78ea3b35128 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf" returned: 0 in 0.850s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b702e4f5-c020-4049-8466-7ee2f845558b req-57f0ad75-b678-4903-8729-a78ea3b35128 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:24:49 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf Jul 09 15:24:49 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:24:50 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 09 15:24:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b702e4f5-c020-4049-8466-7ee2f845558b req-57f0ad75-b678-4903-8729-a78ea3b35128 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf" returned: 1 in 0.784s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:24:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-b702e4f5-c020-4049-8466-7ee2f845558b req-57f0ad75-b678-4903-8729-a78ea3b35128 tempest-TestInstancesWithCinderVolumes-135017459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:24:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-b702e4f5-c020-4049-8466-7ee2f845558b req-57f0ad75-b678-4903-8729-a78ea3b35128 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.705s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:24:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-b702e4f5-c020-4049-8466-7ee2f845558b req-57f0ad75-b678-4903-8729-a78ea3b35128 tempest-TestInstancesWithCinderVolumes-135017459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '382c3dae-b478-4063-8d42-d9065036e17f', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:24:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-b702e4f5-c020-4049-8466-7ee2f845558b req-57f0ad75-b678-4903-8729-a78ea3b35128 tempest-TestInstancesWithCinderVolumes-135017459 None] attachment_update completed successfully. Jul 09 15:25:00 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=74,cinder:INSERT=21,cinder:SELECT=69,cinder:DELETE=5 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:25:03 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:DELETE=11,cinder:SELECT=67,cinder:INSERT=25,cinder:UPDATE=69 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:25:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-8645091f-5a31-48a2-9be9-f6beb296c6bd req-dc92abff-d928-48f0-afb8-0cf6abb32c40 tempest-TestStampPattern-1299061683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-8645091f-5a31-48a2-9be9-f6beb296c6bd req-dc92abff-d928-48f0-afb8-0cf6abb32c40 tempest-TestStampPattern-1299061683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b069c47-2154-4648-9bc1-3f75cfe1c150]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-8645091f-5a31-48a2-9be9-f6beb296c6bd req-dc92abff-d928-48f0-afb8-0cf6abb32c40 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:20 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 Jul 09 15:25:20 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:21 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-8645091f-5a31-48a2-9be9-f6beb296c6bd req-dc92abff-d928-48f0-afb8-0cf6abb32c40 tempest-TestStampPattern-1299061683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530" returned: 0 in 0.763s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-8645091f-5a31-48a2-9be9-f6beb296c6bd req-dc92abff-d928-48f0-afb8-0cf6abb32c40 tempest-TestStampPattern-1299061683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-8645091f-5a31-48a2-9be9-f6beb296c6bd req-dc92abff-d928-48f0-afb8-0cf6abb32c40 tempest-TestStampPattern-1299061683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '507a9861-e568-4098-a6f4-0738df7f842f', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:25:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-8645091f-5a31-48a2-9be9-f6beb296c6bd req-dc92abff-d928-48f0-afb8-0cf6abb32c40 tempest-TestStampPattern-1299061683 None] attachment_update completed successfully. Jul 09 15:25:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a0fd0e50-6a44-47f5-9719-b65e411e43c7 req-a70750fd-f5e5-4526-a1f9-bc34700c28ba tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a0fd0e50-6a44-47f5-9719-b65e411e43c7 req-a70750fd-f5e5-4526-a1f9-bc34700c28ba tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7322b11-a044-42e1-b6c1-48b01893b74b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a0fd0e50-6a44-47f5-9719-b65e411e43c7 req-a70750fd-f5e5-4526-a1f9-bc34700c28ba tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:28 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 Jul 09 15:25:28 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-f3eeff1e-ac74-4fa3-921a-2f43ce8a2f41 req-b8471ef5-2f2d-462a-ab84-8c1d99888f2d tempest-TestStampPattern-1299061683 None] Terminate volume connection completed successfully. Jul 09 15:25:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-f3eeff1e-ac74-4fa3-921a-2f43ce8a2f41 req-b8471ef5-2f2d-462a-ab84-8c1d99888f2d tempest-TestStampPattern-1299061683 None] Deleting attachment 507a9861-e568-4098-a6f4-0738df7f842f. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:25:28 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-a0fd0e50-6a44-47f5-9719-b65e411e43c7 req-a70750fd-f5e5-4526-a1f9-bc34700c28ba tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369" returned: 0 in 0.791s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-a0fd0e50-6a44-47f5-9719-b65e411e43c7 req-a70750fd-f5e5-4526-a1f9-bc34700c28ba tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.807s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-a0fd0e50-6a44-47f5-9719-b65e411e43c7 req-a70750fd-f5e5-4526-a1f9-bc34700c28ba tempest-TestInstancesWithCinderVolumes-135017459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-8f290a6b-a229-412b-8ec5-8b3c87347369', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a69b9f8-b022-4049-9f52-50eed5ad1669', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:25:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-a0fd0e50-6a44-47f5-9719-b65e411e43c7 req-a70750fd-f5e5-4526-a1f9-bc34700c28ba tempest-TestInstancesWithCinderVolumes-135017459 None] attachment_update completed successfully. Jul 09 15:25:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-24ca23b0-6af7-4169-9208-7aede6d74dfb req-88a0d629-6085-42b7-bd14-536a1d39a5e0 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-24ca23b0-6af7-4169-9208-7aede6d74dfb req-88a0d629-6085-42b7-bd14-536a1d39a5e0 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d72e37e-b559-486c-b746-191b22e35093]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-24ca23b0-6af7-4169-9208-7aede6d74dfb req-88a0d629-6085-42b7-bd14-536a1d39a5e0 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:36 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 Jul 09 15:25:36 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:37 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [req-24ca23b0-6af7-4169-9208-7aede6d74dfb req-88a0d629-6085-42b7-bd14-536a1d39a5e0 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7" returned: 0 in 0.760s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [req-24ca23b0-6af7-4169-9208-7aede6d74dfb req-88a0d629-6085-42b7-bd14-536a1d39a5e0 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.778s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-24ca23b0-6af7-4169-9208-7aede6d74dfb req-88a0d629-6085-42b7-bd14-536a1d39a5e0 tempest-TestInstancesWithCinderVolumes-135017459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b', 'name': 'volume-54209dfc-9b93-41da-8fdb-46dd60c935e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b699d97-8e2f-4059-8802-c4717e8a07c1', 'enforce_multipath': True} {{(pid=86916) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 15:25:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-24ca23b0-6af7-4169-9208-7aede6d74dfb req-88a0d629-6085-42b7-bd14-536a1d39a5e0 tempest-TestInstancesWithCinderVolumes-135017459 None] attachment_update completed successfully. Jul 09 15:25:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Acquiring lock "cinder-868ffc2f-bbb7-459a-a4e1-e0cea563b530-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Lock "cinder-868ffc2f-bbb7-459a-a4e1-e0cea563b530-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Acquiring lock "cinder-quobyte-868ffc2f-bbb7-459a-a4e1-e0cea563b530" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-868ffc2f-bbb7-459a-a4e1-e0cea563b530" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5758b8c5-d490-43f7-b069-d8e95cda062a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:38 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 Jul 09 15:25:38 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:39 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530" returned: 0 in 0.767s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:39 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530 Jul 09 15:25:39 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:39 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-868ffc2f-bbb7-459a-a4e1-e0cea563b530" returned: 0 in 0.664s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-868ffc2f-bbb7-459a-a4e1-e0cea563b530" released by "delete_volume" :: held 1.481s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Created reservations ['3fa24661-ca73-4316-858d-df85562a5c50', '740aefcb-d492-4c10-b2fc-1db83beada95', '03d11ef7-3f9c-43db-8516-c9bcfe064094', 'add18ccd-8c01-4e7c-ade1-1322c46853de'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:39 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:25:39 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:40 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.679s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Deleted volume successfully. Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef7b518d-0dfb-4fd5-bc93-171241e8c9cb tempest-TestStampPattern-1299061683 None] Lock "cinder-868ffc2f-bbb7-459a-a4e1-e0cea563b530-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Acquiring lock "cinder-d6e817e2-c1a8-42b6-8174-a1f18cac8dfd-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Lock "cinder-d6e817e2-c1a8-42b6-8174-a1f18cac8dfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Acquiring lock "cinder-quobyte-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Acquiring lock "cinder-quobyte-d6e817e2-c1a8-42b6-8174-a1f18cac8dfd" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-d6e817e2-c1a8-42b6-8174-a1f18cac8dfd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Deleting offline snapshot d6e817e2-c1a8-42b6-8174-a1f18cac8dfd of volume 4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] snapshot_file for this snap is: volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[85304ea3-88c5-4d1b-8a72-9e145ed0a773]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:40 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd Jul 09 15:25:40 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:41 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd" returned: 0 in 0.790s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:25:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee412d1d-87c9-4ad9-90d2-2ced8c519469]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:41 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b Jul 09 15:25:41 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:42 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" returned: 0 in 0.821s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:42 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd Jul 09 15:25:42 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:43 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd" returned: 0 in 0.831s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:43 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd Jul 09 15:25:43 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:43 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b.d6e817e2-c1a8-42b6-8174-a1f18cac8dfd" returned: 0 in 0.650s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-d6e817e2-c1a8-42b6-8174-a1f18cac8dfd" released by "_delete_snapshot" :: held 3.207s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" released by "delete_snapshot" :: held 3.231s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Created reservations ['aa872b3c-dc55-4938-9945-90ac551b9dab', '0a9120e3-74e9-4271-9841-1d4bc516deba', '273c88af-7682-43b0-8f16-f50d079d4f15', '4f8ab7af-9b35-4260-af0f-81064def3950'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Delete snapshot completed successfully. Jul 09 15:25:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b52630ce-8e1a-4b13-8525-ebcbd310ef69 tempest-TestStampPattern-1299061683 None] Lock "cinder-d6e817e2-c1a8-42b6-8174-a1f18cac8dfd-delete_snapshot" released by "delete_snapshot" :: held 3.366s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-e5159019-3b2d-4663-ba60-7e46ac39a8c6 req-ebe81d98-7d75-4aa3-aeb3-7c3d78f95c97 tempest-TestInstancesWithCinderVolumes-135017459 None] Terminate volume connection completed successfully. Jul 09 15:25:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-e5159019-3b2d-4663-ba60-7e46ac39a8c6 req-ebe81d98-7d75-4aa3-aeb3-7c3d78f95c97 tempest-TestInstancesWithCinderVolumes-135017459 None] Deleting attachment 9a69b9f8-b022-4049-9f52-50eed5ad1669. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:25:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:25:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:47 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:25:47 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "cinder-8f290a6b-a229-412b-8ec5-8b3c87347369-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-8f290a6b-a229-412b-8ec5-8b3c87347369-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "cinder-quobyte-8f290a6b-a229-412b-8ec5-8b3c87347369" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-quobyte-8f290a6b-a229-412b-8ec5-8b3c87347369" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[835270f9-0357-475f-bc55-c54d5c48f90f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:48 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 Jul 09 15:25:48 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:48 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.742s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:25:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:25:49 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369" returned: 0 in 0.878s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:49 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369 Jul 09 15:25:49 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:49 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8f290a6b-a229-412b-8ec5-8b3c87347369" returned: 0 in 0.643s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-quobyte-8f290a6b-a229-412b-8ec5-8b3c87347369" released by "delete_volume" :: held 1.592s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:49 devstack cinder-volume[86916]: WARNING cinder.quota [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1142205289-353991046 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1142205289-353991046, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:25:49 devstack cinder-volume[86916]: WARNING cinder.quota [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1142205289-353991046 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1142205289-353991046, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Created reservations ['5d3f336d-21ce-41e3-9739-afa852d6d567', '16264e37-5be6-4cc7-b824-2ff324baa551', '146a19d6-1d1a-499c-9424-d5c9e1d23af3', 'c73a6572-683e-418f-8b3d-0d2e34fd8430'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:49 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:25:49 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:50 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.704s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:50 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Deleted volume successfully. Jul 09 15:25:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-78f0c77c-82d2-4d87-8f03-c197fae49483 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-8f290a6b-a229-412b-8ec5-8b3c87347369-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-2c38da49-d629-408a-9e4b-58c2d86e22c6 req-8a86ee41-8754-498f-a39a-94e2e168f3b8 tempest-TestInstancesWithCinderVolumes-135017459 None] Terminate volume connection completed successfully. Jul 09 15:25:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-2c38da49-d629-408a-9e4b-58c2d86e22c6 req-8a86ee41-8754-498f-a39a-94e2e168f3b8 tempest-TestInstancesWithCinderVolumes-135017459 None] Deleting attachment 8b699d97-8e2f-4059-8802-c4717e8a07c1. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:25:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Acquiring lock "cinder-4e31f98c-5a3a-447e-9801-c0d0cd38e78b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Lock "cinder-4e31f98c-5a3a-447e-9801-c0d0cd38e78b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Acquiring lock "cinder-quobyte-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ad0867-e3a0-4cd0-ab2f-a858e5fc3f47]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:53 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b Jul 09 15:25:53 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:54 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" returned: 0 in 0.771s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:54 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b Jul 09 15:25:54 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "cinder-54209dfc-9b93-41da-8fdb-46dd60c935e7-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-54209dfc-9b93-41da-8fdb-46dd60c935e7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "cinder-quobyte-54209dfc-9b93-41da-8fdb-46dd60c935e7" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-quobyte-54209dfc-9b93-41da-8fdb-46dd60c935e7" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae6a632-870e-41b3-81a5-54c578db012a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:54 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" returned: 0 in 0.683s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Lock "cinder-quobyte-4e31f98c-5a3a-447e-9801-c0d0cd38e78b" released by "delete_volume" :: held 1.517s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Created reservations ['6444b1ae-1dca-4215-b554-e95d46aa486e', '1b7bdcb5-9ace-40a7-a204-e0a778d71175', 'cc5c952a-d90b-4fa7-a4a1-03c0c05cb402', '82f3ec82-ce86-4aec-b780-0bb7cba21f95'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:54 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 Jul 09 15:25:54 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:55 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:25:55 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:55 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7" returned: 0 in 0.922s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:55 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7 Jul 09 15:25:55 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:55 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.773s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Deleted volume successfully. Jul 09 15:25:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ef0ee088-5628-4f67-8b53-e9eac92a0fbd tempest-TestStampPattern-1299061683 None] Lock "cinder-4e31f98c-5a3a-447e-9801-c0d0cd38e78b-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:56 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-54209dfc-9b93-41da-8fdb-46dd60c935e7" returned: 0 in 0.754s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-quobyte-54209dfc-9b93-41da-8fdb-46dd60c935e7" released by "delete_volume" :: held 1.732s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:25:56 devstack cinder-volume[86916]: WARNING cinder.quota [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1478935838-69119207 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1478935838-69119207, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:25:56 devstack cinder-volume[86916]: WARNING cinder.quota [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1478935838-69119207 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1478935838-69119207, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:25:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Created reservations ['273f5234-9f0c-4966-b1d0-2e54be61a9da', '3e05c26a-d40a-49a2-970c-19a6307d4877', '08e46a8c-aa60-4d95-ac18-d9e9088ff202', '6dc5ece9-6555-4e23-a077-1606c6f59ec6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:25:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:25:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:25:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:25:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:25:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:25:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:25:56 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:25:56 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:25:57 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jul 09 15:25:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.822s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:25:57 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:25:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Deleted volume successfully. Jul 09 15:25:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5be6c4d2-325a-4566-8c96-ea4cde5ae8d7 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-54209dfc-9b93-41da-8fdb-46dd60c935e7-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [req-2e08f56b-598e-4172-b2d4-bca85fd35080 req-ac73f904-02ef-448f-90ad-ad1caf873a58 tempest-TestInstancesWithCinderVolumes-135017459 None] Terminate volume connection completed successfully. Jul 09 15:26:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [req-2e08f56b-598e-4172-b2d4-bca85fd35080 req-ac73f904-02ef-448f-90ad-ad1caf873a58 tempest-TestInstancesWithCinderVolumes-135017459 None] Deleting attachment 382c3dae-b478-4063-8d42-d9065036e17f. {{(pid=86916) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 15:26:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "cinder-6466b54c-e12f-466c-82c6-ef02f0fc9abf-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-6466b54c-e12f-466c-82c6-ef02f0fc9abf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "cinder-quobyte-6466b54c-e12f-466c-82c6-ef02f0fc9abf" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-quobyte-6466b54c-e12f-466c-82c6-ef02f0fc9abf" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd986a6-2be1-40b8-86b4-2f9292d4992f]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:06 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf Jul 09 15:26:06 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:07 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf" returned: 0 in 0.751s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Flow 'volume_create_manager' (036971b4-89e5-4bf3-bca4-64ffa196eaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e57b86-a0ad-4c0b-8fec-3bbc5c2cdaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e57b86-a0ad-4c0b-8fec-3bbc5c2cdaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-468355019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6059f3-f19e-43d8-a99a-d7027aedce33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbee62899f54e4d9075708918b6fb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:07Z,use_quota=True,user_id='c54a1fc01b50482c9efb13a670bad3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da48558a-ab24-4c54-a993-4205c99695b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da48558a-ab24-4c54-a993-4205c99695b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b489c99e-8a69-4a9c-8277-a03ca299aaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b489c99e-8a69-4a9c-8277-a03ca299aaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6059f3-f19e-43d8-a99a-d7027aedce33', 'volume_name': 'volume-0c6059f3-f19e-43d8-a99a-d7027aedce33', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0dfb162-71f0-4806-b5aa-171290cd0224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0dfb162-71f0-4806-b5aa-171290cd0224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846e8020-3075-4ca4-9be9-9754965a0247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Volume 0c6059f3-f19e-43d8-a99a-d7027aedce33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6059f3-f19e-43d8-a99a-d7027aedce33', 'volume_size': 1} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-468355019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6059f3-f19e-43d8-a99a-d7027aedce33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbee62899f54e4d9075708918b6fb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:07Z,use_quota=True,user_id='c54a1fc01b50482c9efb13a670bad3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Creating volume 0c6059f3-f19e-43d8-a99a-d7027aedce33 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:07 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:07 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:07 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:07 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33 1073741824 Jul 09 15:26:07 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Flow 'volume_create_manager' (0aa02c3b-5a19-4d27-85cf-dd8c73fa1e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d08682-31b3-44ff-9472-795b342ee21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d08682-31b3-44ff-9472-795b342ee21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847485544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d92722-e30b-4bd9-8afb-d6f016f4efb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbee62899f54e4d9075708918b6fb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:08Z,use_quota=True,user_id='c54a1fc01b50482c9efb13a670bad3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86b45a5-03cd-49a1-b6dc-a337b8af6de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86b45a5-03cd-49a1-b6dc-a337b8af6de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b6de20-3c83-404e-b696-87ec829d1b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b6de20-3c83-404e-b696-87ec829d1b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d92722-e30b-4bd9-8afb-d6f016f4efb2', 'volume_name': 'volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e130cc-1862-4171-9e60-e900131ce7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e130cc-1862-4171-9e60-e900131ce7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683449b1-5210-4aa3-a93b-452ed9c61f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Volume 30d92722-e30b-4bd9-8afb-d6f016f4efb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2', 'volume_size': 1} Jul 09 15:26:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:08 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Flow 'volume_create_manager' (b326126d-b2dd-40a5-a671-bc6cafcaa353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930c2746-692f-49e9-a12c-82cc0cb255b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf" returned: 1 in 0.870s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:08 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf Jul 09 15:26:08 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930c2746-692f-49e9-a12c-82cc0cb255b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191335772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b13cdc-38f9-42df-b7bb-8ebb272bde07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbee62899f54e4d9075708918b6fb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:08Z,use_quota=True,user_id='c54a1fc01b50482c9efb13a670bad3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc62be4-f5ef-494d-b556-f4ba764361d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc62be4-f5ef-494d-b556-f4ba764361d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df997620-7932-4219-bd0e-4569be21f36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df997620-7932-4219-bd0e-4569be21f36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b13cdc-38f9-42df-b7bb-8ebb272bde07', 'volume_name': 'volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6355392-baab-4fd0-a807-41085ff96ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6355392-baab-4fd0-a807-41085ff96ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4585e9-271b-4427-838f-063814e83295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Volume c1b13cdc-38f9-42df-b7bb-8ebb272bde07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07', 'volume_size': 1} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:08 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33 1073741824" returned: 0 in 1.121s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Flow 'volume_create_manager' (ee429ad2-3020-4ce0-9546-71aec5ff07e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97fa179f-15a8-4bbe-867b-ce845882d413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97fa179f-15a8-4bbe-867b-ce845882d413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21279022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cb428a-4974-479e-a3cb-b3e9859fc98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbee62899f54e4d9075708918b6fb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:09Z,use_quota=True,user_id='c54a1fc01b50482c9efb13a670bad3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a2cc77-d4b1-4544-9422-395ff1afdb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a2cc77-d4b1-4544-9422-395ff1afdb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9e4b31-7017-42bb-ab66-6bc13c2a4038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9e4b31-7017-42bb-ab66-6bc13c2a4038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4cb428a-4974-479e-a3cb-b3e9859fc98d', 'volume_name': 'volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9f8485-050f-414c-af3f-2ef386129b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9f8485-050f-414c-af3f-2ef386129b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc130e62-6d73-450a-b794-eb81fbffceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:08 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Volume c4cb428a-4974-479e-a3cb-b3e9859fc98d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d', 'volume_size': 1} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:08 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33 Jul 09 15:26:08 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Flow 'volume_create_manager' (e903ce22-4230-4a73-a0b7-5c90fb5b0bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e7a3b1-31b5-4fca-867b-11ec58391be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e7a3b1-31b5-4fca-867b-11ec58391be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264737171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ca0937-9124-4bfc-b904-1ec49e06f4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbee62899f54e4d9075708918b6fb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:09Z,use_quota=True,user_id='c54a1fc01b50482c9efb13a670bad3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:09 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a608fcf-fb2a-4273-a738-b398f1c22028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a608fcf-fb2a-4273-a738-b398f1c22028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cf4377-1d6b-4178-ba2d-b5d29dbfc9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cf4377-1d6b-4178-ba2d-b5d29dbfc9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ca0937-9124-4bfc-b904-1ec49e06f4ac', 'volume_name': 'volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf12ccc-7e27-47a1-b116-7069a580d9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf12ccc-7e27-47a1-b116-7069a580d9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d760f9-e7ec-4a0e-8bd4-159353449d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Volume 36ca0937-9124-4bfc-b904-1ec49e06f4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac', 'volume_size': 1} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6466b54c-e12f-466c-82c6-ef02f0fc9abf" returned: 0 in 0.833s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-quobyte-6466b54c-e12f-466c-82c6-ef02f0fc9abf" released by "delete_volume" :: held 2.517s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:09 devstack cinder-volume[86916]: WARNING cinder.quota [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1052662889-850691228 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1052662889-850691228, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:26:09 devstack cinder-volume[86916]: WARNING cinder.quota [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1052662889-850691228 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1052662889-850691228, it is now deprecated. Please use the default quota class for default quota. Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Created reservations ['08342411-7e2d-4634-bfb8-d65c21f20a40', 'd81bfccb-5aa8-4137-82ce-f4d19e26d04d', 'cd8051b8-ece4-4b92-8fae-bc56d7fffbb7', 'a80ee778-9c97-4f6b-9df7-bcbe17c223ba'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:09 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:09 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:09 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33" returned: 0 in 0.687s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847485544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d92722-e30b-4bd9-8afb-d6f016f4efb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbee62899f54e4d9075708918b6fb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:08Z,use_quota=True,user_id='c54a1fc01b50482c9efb13a670bad3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Creating volume 30d92722-e30b-4bd9-8afb-d6f016f4efb2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:09 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846e8020-3075-4ca4-9be9-9754965a0247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6059f3-f19e-43d8-a99a-d7027aedce33', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:09 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2 1073741824 Jul 09 15:26:09 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68dbf7e-3135-4651-a8e0-42abfa2b6c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:09 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Volume volume-0c6059f3-f19e-43d8-a99a-d7027aedce33 (0c6059f3-f19e-43d8-a99a-d7027aedce33): created successfully Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68dbf7e-3135-4651-a8e0-42abfa2b6c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Flow 'volume_create_manager' (036971b4-89e5-4bf3-bca4-64ffa196eaec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-75e48694-f83e-4858-9af2-dce59b79cf65 tempest-CreateVolumesFromImageTest-1254212578 None] Created volume successfully. Jul 09 15:26:09 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.693s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Deleted volume successfully. Jul 09 15:26:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-436f4818-c6bb-4062-8258-48e3210d9304 tempest-TestInstancesWithCinderVolumes-135017459 None] Lock "cinder-6466b54c-e12f-466c-82c6-ef02f0fc9abf-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:10 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2 1073741824" returned: 0 in 0.876s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:10 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2 Jul 09 15:26:10 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:11 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2" returned: 0 in 0.689s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.731s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191335772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b13cdc-38f9-42df-b7bb-8ebb272bde07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbee62899f54e4d9075708918b6fb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:08Z,use_quota=True,user_id='c54a1fc01b50482c9efb13a670bad3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Creating volume c1b13cdc-38f9-42df-b7bb-8ebb272bde07 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:11 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683449b1-5210-4aa3-a93b-452ed9c61f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:11 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07 1073741824 Jul 09 15:26:11 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdf9d40-d9e1-4343-a71a-fe4782da4fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Volume volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2 (30d92722-e30b-4bd9-8afb-d6f016f4efb2): created successfully Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdf9d40-d9e1-4343-a71a-fe4782da4fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Flow 'volume_create_manager' (0aa02c3b-5a19-4d27-85cf-dd8c73fa1e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-111c7cf0-5f5c-4dfc-a465-46c33799c5cb tempest-CreateVolumesFromImageTest-1254212578 None] Created volume successfully. Jul 09 15:26:12 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07 1073741824" returned: 0 in 0.906s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:12 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07 Jul 09 15:26:12 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:12 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07" returned: 0 in 0.703s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.995s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21279022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cb428a-4974-479e-a3cb-b3e9859fc98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbee62899f54e4d9075708918b6fb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:09Z,use_quota=True,user_id='c54a1fc01b50482c9efb13a670bad3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Creating volume c4cb428a-4974-479e-a3cb-b3e9859fc98d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:12 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:12 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d 1073741824 Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4585e9-271b-4427-838f-063814e83295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:12 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4155185e-dcb9-48b8-9f00-5359b7f1da27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Volume volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07 (c1b13cdc-38f9-42df-b7bb-8ebb272bde07): created successfully Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4155185e-dcb9-48b8-9f00-5359b7f1da27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Flow 'volume_create_manager' (b326126d-b2dd-40a5-a671-bc6cafcaa353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-824b7c99-7a76-4fc2-b238-580b2be7eb26 tempest-CreateVolumesFromImageTest-1254212578 None] Created volume successfully. Jul 09 15:26:13 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d 1073741824" returned: 0 in 0.998s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:13 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=60,cinder:UPDATE=67,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:26:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:13 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d Jul 09 15:26:13 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:14 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d" returned: 0 in 0.709s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.420s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264737171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ca0937-9124-4bfc-b904-1ec49e06f4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbee62899f54e4d9075708918b6fb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:09Z,use_quota=True,user_id='c54a1fc01b50482c9efb13a670bad3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Creating volume 36ca0937-9124-4bfc-b904-1ec49e06f4ac {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:14 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc130e62-6d73-450a-b794-eb81fbffceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:14 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac 1073741824 Jul 09 15:26:14 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ff83ab-439d-45b1-ab2d-0b690e0e8dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Volume volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d (c4cb428a-4974-479e-a3cb-b3e9859fc98d): created successfully Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ff83ab-439d-45b1-ab2d-0b690e0e8dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Flow 'volume_create_manager' (ee429ad2-3020-4ce0-9546-71aec5ff07e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-661b9396-c495-433a-98f1-86da1fdf867c tempest-CreateVolumesFromImageTest-1254212578 None] Created volume successfully. Jul 09 15:26:15 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac 1073741824" returned: 0 in 0.874s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:15 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac Jul 09 15:26:15 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:16 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac" returned: 0 in 0.662s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d760f9-e7ec-4a0e-8bd4-159353449d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e3b785-3789-4cc1-bc22-82693228414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:16 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Volume volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac (36ca0937-9124-4bfc-b904-1ec49e06f4ac): created successfully Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e3b785-3789-4cc1-bc22-82693228414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Flow 'volume_create_manager' (e903ce22-4230-4a73-a0b7-5c90fb5b0bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ddf01824-93cc-430d-9489-5276d855a971 tempest-CreateVolumesFromImageTest-1254212578 None] Created volume successfully. Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "cinder-36ca0937-9124-4bfc-b904-1ec49e06f4ac-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-36ca0937-9124-4bfc-b904-1ec49e06f4ac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "cinder-quobyte-36ca0937-9124-4bfc-b904-1ec49e06f4ac" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-quobyte-36ca0937-9124-4bfc-b904-1ec49e06f4ac" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8891cf-bd2d-4834-a478-1577877460ad]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:17 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac Jul 09 15:26:17 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:17 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac" returned: 0 in 0.821s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:17 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac Jul 09 15:26:17 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:18 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-36ca0937-9124-4bfc-b904-1ec49e06f4ac" returned: 0 in 0.695s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-quobyte-36ca0937-9124-4bfc-b904-1ec49e06f4ac" released by "delete_volume" :: held 1.560s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Created reservations ['571ce52b-2ae0-4e4b-a1a3-b8476725ddd7', '1d2843a5-2f78-42fa-ac6d-25d728a2b2ce', '4663bd18-6fac-4cc4-aadf-e61782f35975', '43a6657d-a306-4690-9038-6391e00cd77a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:18 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:18 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "cinder-c4cb428a-4974-479e-a3cb-b3e9859fc98d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-c4cb428a-4974-479e-a3cb-b3e9859fc98d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "cinder-quobyte-c4cb428a-4974-479e-a3cb-b3e9859fc98d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-quobyte-c4cb428a-4974-479e-a3cb-b3e9859fc98d" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf65cc06-ad14-40d6-98ff-c56e57bbba45]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:19 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.685s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Deleted volume successfully. Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-72a69050-3931-4331-a19b-41b9e45a9f40 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-36ca0937-9124-4bfc-b904-1ec49e06f4ac-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:19 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d Jul 09 15:26:19 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:19 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d" returned: 0 in 0.823s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:19 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d Jul 09 15:26:19 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:20 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c4cb428a-4974-479e-a3cb-b3e9859fc98d" returned: 0 in 0.690s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-quobyte-c4cb428a-4974-479e-a3cb-b3e9859fc98d" released by "delete_volume" :: held 1.565s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:20 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=69,cinder:UPDATE=69,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:26:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Created reservations ['fecff658-060f-4bc8-b403-2fdeea5d1f9e', '7cec7044-69f3-40b5-81e5-969d32d7e447', '88350efe-ef4d-4470-9ff3-2314da8be725', '814e407a-cc09-4220-a2bd-4ebb9847842e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:20 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:20 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (90048c0e-7c6b-4afd-b879-9ec7055e1114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cbb62f-6102-472c-a3ce-937cf230b8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cbb62f-6102-472c-a3ce-937cf230b8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-920432062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:21Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb0afb92-1c85-4909-96f4-f47022737ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb0afb92-1c85-4909-96f4-f47022737ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4695ae-2f74-48d3-bbee-81495a15cb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4695ae-2f74-48d3-bbee-81495a15cb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c', 'volume_name': 'volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd462b3c-cc62-4490-82e4-67220fdc9fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd462b3c-cc62-4490-82e4-67220fdc9fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c728be8-755c-4838-b18e-7ec22b289a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c', 'volume_size': 1} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-920432062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:21Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Creating volume b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:21 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "cinder-c1b13cdc-38f9-42df-b7bb-8ebb272bde07-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:21 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c 1073741824 Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-c1b13cdc-38f9-42df-b7bb-8ebb272bde07-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:21 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "cinder-quobyte-c1b13cdc-38f9-42df-b7bb-8ebb272bde07" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-quobyte-c1b13cdc-38f9-42df-b7bb-8ebb272bde07" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[629ce215-d314-44e3-802d-141662356f56]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:21 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.677s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Deleted volume successfully. Jul 09 15:26:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b2f9448e-c63e-43e6-9005-7e484b67f2e8 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-c4cb428a-4974-479e-a3cb-b3e9859fc98d-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:21 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07 Jul 09 15:26:21 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:22 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c 1073741824" returned: 0 in 0.867s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:22 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07" returned: 0 in 0.754s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:22 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07 Jul 09 15:26:22 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:22 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c Jul 09 15:26:22 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:22 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-c1b13cdc-38f9-42df-b7bb-8ebb272bde07" returned: 0 in 0.618s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-quobyte-c1b13cdc-38f9-42df-b7bb-8ebb272bde07" released by "delete_volume" :: held 1.417s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:22 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c" returned: 0 in 0.659s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Created reservations ['42e3810c-06b0-439d-bc25-43ea743078d9', '49edd0ef-458e-43ee-b62d-9c443121bf90', '6103c99f-e696-46cd-ab41-5f487dbe0d5b', '677c56b8-f210-4940-81b8-eec7e0d92da6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c728be8-755c-4838-b18e-7ec22b289a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee179da-e79e-4c27-bad1-6cedc03585fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c (b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c): created successfully Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee179da-e79e-4c27-bad1-6cedc03585fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (90048c0e-7c6b-4afd-b879-9ec7055e1114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a970a4a1-5c18-4bc8-80f3-6fd40eba65f1 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created volume successfully. Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:22 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:22 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "cinder-30d92722-e30b-4bd9-8afb-d6f016f4efb2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-30d92722-e30b-4bd9-8afb-d6f016f4efb2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:23 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.678s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Deleted volume successfully. Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "cinder-quobyte-30d92722-e30b-4bd9-8afb-d6f016f4efb2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f3a121d8-3b3d-476f-a929-feef18cb7a75 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-c1b13cdc-38f9-42df-b7bb-8ebb272bde07-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-quobyte-30d92722-e30b-4bd9-8afb-d6f016f4efb2" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3747e095-4d16-43bd-9774-ec160e2cfeb2]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (c50c350a-060e-485b-827a-3e5265f430ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ed5235-c383-439d-8660-5ba2ba8f0129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ed5235-c383-439d-8660-5ba2ba8f0129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-248760267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2511b4-2969-485e-8603-1df981a44c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:24Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2406abb-1d27-4a29-87f0-9bb3a4b1e508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2406abb-1d27-4a29-87f0-9bb3a4b1e508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf90c04-1284-4995-9717-4ec0b182c47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:23 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2 Jul 09 15:26:23 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf90c04-1284-4995-9717-4ec0b182c47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d2511b4-2969-485e-8603-1df981a44c8b', 'volume_name': 'volume-8d2511b4-2969-485e-8603-1df981a44c8b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ed0090-14d6-4953-9961-88df623f4bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ed0090-14d6-4953-9961-88df623f4bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962f21f2-beb4-46f7-8c5d-1197ce484e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:23 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume 8d2511b4-2969-485e-8603-1df981a44c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d2511b4-2969-485e-8603-1df981a44c8b', 'volume_size': 1} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-248760267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2511b4-2969-485e-8603-1df981a44c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:24Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Creating volume 8d2511b4-2969-485e-8603-1df981a44c8b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:23 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:23 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b 1073741824 Jul 09 15:26:23 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (2b31a75c-fa44-4b17-af1b-7a10807631d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795ee8a3-9f93-42ea-9a5d-ec6c645aae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795ee8a3-9f93-42ea-9a5d-ec6c645aae6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1503908982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27631201-80ee-450b-9a05-c5d200271d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:24Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3a4ce6-2d3b-4565-8b55-819f14c1c119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3a4ce6-2d3b-4565-8b55-819f14c1c119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff26dc6-a331-4577-b8a9-2c2d7b7aa819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff26dc6-a331-4577-b8a9-2c2d7b7aa819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27631201-80ee-450b-9a05-c5d200271d52', 'volume_name': 'volume-27631201-80ee-450b-9a05-c5d200271d52', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a69bcd-3dce-4910-b8e5-dcd6184cf221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a69bcd-3dce-4910-b8e5-dcd6184cf221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e453cbf-29a5-46b3-8e51-2d8562eb6a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume 27631201-80ee-450b-9a05-c5d200271d52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27631201-80ee-450b-9a05-c5d200271d52', 'volume_size': 1} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (d60f4808-c40b-4cae-bd4c-5032bd7ab703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:24 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b1d020-97cc-4a92-97f8-6633e19ebd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2" returned: 0 in 0.949s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b1d020-97cc-4a92-97f8-6633e19ebd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984267888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef9473d-e571-43f8-a284-437d1a078751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:25Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad05cce3-483a-456f-8996-565d5479afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:24 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2 Jul 09 15:26:24 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad05cce3-483a-456f-8996-565d5479afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13ca6eb-14e3-40bd-852f-0d1edf4e6e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13ca6eb-14e3-40bd-852f-0d1edf4e6e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef9473d-e571-43f8-a284-437d1a078751', 'volume_name': 'volume-8ef9473d-e571-43f8-a284-437d1a078751', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e01472-d41d-4785-83ed-76a61368a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e01472-d41d-4785-83ed-76a61368a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e07dd53-9ae7-4fe0-b466-8377bec5accd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:24 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume 8ef9473d-e571-43f8-a284-437d1a078751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef9473d-e571-43f8-a284-437d1a078751', 'volume_size': 1} Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:24 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b 1073741824" returned: 0 in 1.084s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:25 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b Jul 09 15:26:25 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (a92797cc-7a8f-428d-ad29-8ac5afe1e8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3fb250-f4a4-4146-92d6-65d9c2c157a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3fb250-f4a4-4146-92d6-65d9c2c157a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1351897656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e36e797-bb7d-48d1-ab9a-ac63f38828f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:25Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ce7d32-b094-4e30-8558-e090cb137d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ce7d32-b094-4e30-8558-e090cb137d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d5181e-1895-4249-a39d-fa1db61afe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d5181e-1895-4249-a39d-fa1db61afe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e36e797-bb7d-48d1-ab9a-ac63f38828f7', 'volume_name': 'volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e255af8-8600-4526-a6f4-b2084f9cc74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e255af8-8600-4526-a6f4-b2084f9cc74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2e4a87-7eb0-479b-acf2-cd60e10a1059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume 0e36e797-bb7d-48d1-ab9a-ac63f38828f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7', 'volume_size': 1} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (4c8b9564-e583-436d-a700-610e69da2dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db1adfe-71eb-4af6-8043-f52097ea8d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db1adfe-71eb-4af6-8043-f52097ea8d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-42172004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553cabac-60d5-4b58-b984-9e8011185716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:25Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca96436-e527-41ba-8814-6a9e9f5686c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca96436-e527-41ba-8814-6a9e9f5686c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffbbecf-3066-43c4-9f8d-0b51bee88a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffbbecf-3066-43c4-9f8d-0b51bee88a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553cabac-60d5-4b58-b984-9e8011185716', 'volume_name': 'volume-553cabac-60d5-4b58-b984-9e8011185716', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2049768f-4e01-4019-bdd7-61010f73d837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2049768f-4e01-4019-bdd7-61010f73d837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5b987a-d373-4c1b-8f1b-904dd3c5d1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume 553cabac-60d5-4b58-b984-9e8011185716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553cabac-60d5-4b58-b984-9e8011185716', 'volume_size': 1} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-30d92722-e30b-4bd9-8afb-d6f016f4efb2" returned: 0 in 0.880s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-quobyte-30d92722-e30b-4bd9-8afb-d6f016f4efb2" released by "delete_volume" :: held 1.871s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Created reservations ['0718018b-db99-484d-8417-4824cff0e74e', '43d08d26-ca8b-4996-9360-301c16275e49', '05103335-f767-4a5b-95b5-4199eb7a2a47', 'bbd59ea3-a4c1-47d7-9675-1ba49863b114'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:25 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b" returned: 0 in 0.672s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.437s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1503908982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27631201-80ee-450b-9a05-c5d200271d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:24Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Creating volume 27631201-80ee-450b-9a05-c5d200271d52 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:25 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:25 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:25 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:25 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52 1073741824 Jul 09 15:26:25 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962f21f2-beb4-46f7-8c5d-1197ce484e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d2511b4-2969-485e-8603-1df981a44c8b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c330c9-fda4-4c9c-9785-32615109aad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume volume-8d2511b4-2969-485e-8603-1df981a44c8b (8d2511b4-2969-485e-8603-1df981a44c8b): created successfully Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c330c9-fda4-4c9c-9785-32615109aad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (c50c350a-060e-485b-827a-3e5265f430ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-55c05ac2-9177-42e0-8036-2006b89aa7fe tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created volume successfully. Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "cinder-0c6059f3-f19e-43d8-a99a-d7027aedce33-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-0c6059f3-f19e-43d8-a99a-d7027aedce33-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "cinder-quobyte-0c6059f3-f19e-43d8-a99a-d7027aedce33" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-quobyte-0c6059f3-f19e-43d8-a99a-d7027aedce33" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35a6f78-e5f7-4c60-aefa-81abe223a0aa]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:26 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33 Jul 09 15:26:26 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:26 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.697s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:26 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Deleted volume successfully. Jul 09 15:26:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9b846f47-8d40-4d19-b622-e392ea65d5c1 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-30d92722-e30b-4bd9-8afb-d6f016f4efb2-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:26 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52 1073741824" returned: 0 in 0.943s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:26 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52 Jul 09 15:26:26 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:26 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33" returned: 0 in 0.802s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:26 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33 Jul 09 15:26:26 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:27 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52" returned: 0 in 0.684s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.595s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984267888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef9473d-e571-43f8-a284-437d1a078751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:25Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Creating volume 8ef9473d-e571-43f8-a284-437d1a078751 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:27 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e453cbf-29a5-46b3-8e51-2d8562eb6a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27631201-80ee-450b-9a05-c5d200271d52', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:27 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751 1073741824 Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f86979d-0486-4c9b-977e-6db9f9d9a4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:27 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:27 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0c6059f3-f19e-43d8-a99a-d7027aedce33" returned: 0 in 0.641s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-quobyte-0c6059f3-f19e-43d8-a99a-d7027aedce33" released by "delete_volume" :: held 1.499s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:27 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume volume-27631201-80ee-450b-9a05-c5d200271d52 (27631201-80ee-450b-9a05-c5d200271d52): created successfully Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f86979d-0486-4c9b-977e-6db9f9d9a4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (2b31a75c-fa44-4b17-af1b-7a10807631d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-78b72fc4-baf0-4a9b-8a40-da6e022799bb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created volume successfully. Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Created reservations ['d85bcef5-d169-4b63-8217-16b6ed8be114', 'ced20ea2-93f3-4ba8-851f-7dda8991ed6f', '94df2f15-ff1d-4e12-90e4-30b03e79db9d', '4f94404a-d95d-4600-963c-efedc41b4011'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:27 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:27 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:28 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.638s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Deleted volume successfully. Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e73f73c5-172a-4a55-a693-c843f2559c44 tempest-CreateVolumesFromImageTest-1254212578 None] Lock "cinder-0c6059f3-f19e-43d8-a99a-d7027aedce33-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:28 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751 1073741824" returned: 0 in 0.871s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:28 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751 Jul 09 15:26:28 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:28 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751" returned: 0 in 0.683s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.788s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1351897656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e36e797-bb7d-48d1-ab9a-ac63f38828f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:25Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Creating volume 0e36e797-bb7d-48d1-ab9a-ac63f38828f7 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:28 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e07dd53-9ae7-4fe0-b466-8377bec5accd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef9473d-e571-43f8-a284-437d1a078751', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:29 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7 1073741824 Jul 09 15:26:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf58b80-052a-4d13-9929-1189ae13f616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:29 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume volume-8ef9473d-e571-43f8-a284-437d1a078751 (8ef9473d-e571-43f8-a284-437d1a078751): created successfully Jul 09 15:26:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf58b80-052a-4d13-9929-1189ae13f616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (d60f4808-c40b-4cae-bd4c-5032bd7ab703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5d2e4d3b-704e-4325-8999-1c69801f70d8 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created volume successfully. Jul 09 15:26:29 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7 1073741824" returned: 0 in 0.931s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:29 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7 Jul 09 15:26:29 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:30 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7" returned: 0 in 0.705s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.107s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-42172004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553cabac-60d5-4b58-b984-9e8011185716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7fa3e335f54e5daacb18dd341acbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:25Z,use_quota=True,user_id='01874776c2fe4f0a88b14d200354dfa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Creating volume 553cabac-60d5-4b58-b984-9e8011185716 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:30 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716 1073741824 Jul 09 15:26:30 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2e4a87-7eb0-479b-acf2-cd60e10a1059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f54a57-75f2-4c78-98c5-f748ae6c7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7 (0e36e797-bb7d-48d1-ab9a-ac63f38828f7): created successfully Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f54a57-75f2-4c78-98c5-f748ae6c7d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (a92797cc-7a8f-428d-ad29-8ac5afe1e8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fc5b581e-6b0d-4796-9260-c88df7786171 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created volume successfully. Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (82ea27d3-8e4f-4285-8614-e58e7d3c4b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92c248a-150a-462c-bfaa-197fe3ccc0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92c248a-150a-462c-bfaa-197fe3ccc0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1205825267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:31Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7c41c6-9e2c-49c9-ba01-592091917257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7c41c6-9e2c-49c9-ba01-592091917257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b913c9-defb-44a2-a0e9-5f4c87c8af98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b913c9-defb-44a2-a0e9-5f4c87c8af98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2', 'volume_name': 'volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb8e9e3-1caf-4971-a962-0709ae21b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb8e9e3-1caf-4971-a962-0709ae21b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba88db3e-b6ec-49c9-8539-bbee7affab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume 1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2', 'volume_size': 1} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:31 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716 1073741824" returned: 0 in 0.865s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:31 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716 Jul 09 15:26:31 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:32 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716" returned: 0 in 0.664s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.868s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1205825267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:31Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Creating volume 1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:32 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5b987a-d373-4c1b-8f1b-904dd3c5d1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553cabac-60d5-4b58-b984-9e8011185716', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:32 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 1073741824 Jul 09 15:26:32 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f02986-0aa5-46fc-8539-cf276d1431f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Volume volume-553cabac-60d5-4b58-b984-9e8011185716 (553cabac-60d5-4b58-b984-9e8011185716): created successfully Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f02986-0aa5-46fc-8539-cf276d1431f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Flow 'volume_create_manager' (4c8b9564-e583-436d-a700-610e69da2dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-21668927-b76d-4e27-bad0-390bc2ecb5be tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created volume successfully. Jul 09 15:26:33 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 1073741824" returned: 0 in 0.784s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:33 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 Jul 09 15:26:33 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-553cabac-60d5-4b58-b984-9e8011185716-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-553cabac-60d5-4b58-b984-9e8011185716-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-quobyte-553cabac-60d5-4b58-b984-9e8011185716" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-553cabac-60d5-4b58-b984-9e8011185716" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e7d17c-a8f3-48cd-a82a-5fbb2257dd35]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:33 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716 Jul 09 15:26:33 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:33 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" returned: 0 in 0.639s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba88db3e-b6ec-49c9-8539-bbee7affab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1470d3bc-64f7-4812-b823-a09c160c3af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 (1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2): created successfully Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1470d3bc-64f7-4812-b823-a09c160c3af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (82ea27d3-8e4f-4285-8614-e58e7d3c4b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e83383c8-57e0-47f5-a297-fb765d622b47 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created volume successfully. Jul 09 15:26:34 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716" returned: 0 in 0.786s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:34 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716 Jul 09 15:26:34 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Creating offline snapshot db44bfc1-93cc-49d2-b356-5097544472a2 of volume 1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[125c7500-7f4b-447b-aeb1-a2883cb6c0bf]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:34 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-553cabac-60d5-4b58-b984-9e8011185716" returned: 0 in 0.651s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-553cabac-60d5-4b58-b984-9e8011185716" released by "delete_volume" :: held 1.482s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:34 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 Jul 09 15:26:34 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created reservations ['0ad93550-e314-450d-ad8e-0410a0e45647', '2db25dc6-a398-43e3-98ff-ff7e5fc3d85c', 'f9edfc0f-6d0d-434d-ab8f-6396d646141e', 'fd8f372c-4133-443f-9730-87ef9b465903'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:34 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:34 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:35 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" returned: 0 in 0.756s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-0e36e797-bb7d-48d1-ab9a-ac63f38828f7-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:35 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 1G Jul 09 15:26:35 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-0e36e797-bb7d-48d1-ab9a-ac63f38828f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-quobyte-0e36e797-bb7d-48d1-ab9a-ac63f38828f7" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-0e36e797-bb7d-48d1-ab9a-ac63f38828f7" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:35 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.680s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Deleted volume successfully. Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e844b058-d2a6-4c57-a0ce-b3a660ae3da8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b6c3a079-c47b-42a9-b804-292d65b9d7cb tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-553cabac-60d5-4b58-b984-9e8011185716-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:35 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7 Jul 09 15:26:35 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:36 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 1G" returned: 0 in 0.801s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:36 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 Jul 09 15:26:36 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:36 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7" returned: 0 in 0.806s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:36 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7 Jul 09 15:26:36 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:36 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2" returned: 0 in 0.688s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:36 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 is being set with open permissions: ugo+rw Jul 09 15:26:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:36 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 Jul 09 15:26:36 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:37 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-0e36e797-bb7d-48d1-ab9a-ac63f38828f7" returned: 0 in 0.679s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-0e36e797-bb7d-48d1-ab9a-ac63f38828f7" released by "delete_volume" :: held 1.539s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created reservations ['2bf68281-f59f-4f5e-8e6f-b69057ccead4', '7327f770-ca2c-4b41-ab2d-9492087287b9', 'b6288114-a390-410e-a820-23f27ce17178', 'de77a58c-2d5c-4628-b43c-566ee7eea563'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:37 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:37 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:37 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2" returned: 0 in 0.687s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-8ef9473d-e571-43f8-a284-437d1a078751-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:37 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.info Jul 09 15:26:37 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-8ef9473d-e571-43f8-a284-437d1a078751-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-quobyte-8ef9473d-e571-43f8-a284-437d1a078751" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-8ef9473d-e571-43f8-a284-437d1a078751" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff103dd-7baa-4452-a2bf-733414381415]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:37 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.672s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Deleted volume successfully. Jul 09 15:26:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-667508d8-999a-4d65-9af0-3ad8d43d0847 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-0e36e797-bb7d-48d1-ab9a-ac63f38828f7-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:37 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751 Jul 09 15:26:37 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:38 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.info" returned: 0 in 0.677s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:38 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.info is being set with open permissions: ugo+rw Jul 09 15:26:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:38 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.info Jul 09 15:26:38 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:38 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751" returned: 0 in 0.788s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:38 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751 Jul 09 15:26:38 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:38 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.info" returned: 0 in 0.619s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.376s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1ce19ddf-e12d-4594-bd95-e377ba1213c0 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Create snapshot completed successfully Jul 09 15:26:39 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8ef9473d-e571-43f8-a284-437d1a078751" returned: 0 in 0.680s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-8ef9473d-e571-43f8-a284-437d1a078751" released by "delete_volume" :: held 1.514s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created reservations ['cd04142e-65ed-4142-a7cf-d9e2412a2767', 'effd7cda-23a2-42c1-b55c-fa5414ffdf63', '7ccf3734-40d4-4990-aa78-6ea18119f700', '2e2f8389-b6b7-408d-bf26-517056419280'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:39 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:39 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-27631201-80ee-450b-9a05-c5d200271d52-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-27631201-80ee-450b-9a05-c5d200271d52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-quobyte-27631201-80ee-450b-9a05-c5d200271d52" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-27631201-80ee-450b-9a05-c5d200271d52" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1112e848-8ffd-441e-a15e-db61975a2b0a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:40 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.703s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Deleted volume successfully. Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5fac5e82-8014-4bb5-81fa-e20f5869b7a5 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-8ef9473d-e571-43f8-a284-437d1a078751-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:40 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52 Jul 09 15:26:40 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (c58050d2-d256-4c09-8829-3180a03e62f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d0268e-ebea-4658-827a-d621576b3640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d0268e-ebea-4658-827a-d621576b3640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-710238059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4a28a2-1361-497e-ba80-dc1f2705284d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:40Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d3ef80-9dae-4ba3-8069-3c957de12e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d3ef80-9dae-4ba3-8069-3c957de12e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af934ac2-d13e-4a75-b97c-f06ec2fbb863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af934ac2-d13e-4a75-b97c-f06ec2fbb863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4a28a2-1361-497e-ba80-dc1f2705284d', 'volume_name': 'volume-dc4a28a2-1361-497e-ba80-dc1f2705284d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28aaf528-4189-4d39-bb31-5ad6882b134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28aaf528-4189-4d39-bb31-5ad6882b134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d11264-3390-4f97-aef9-239d072146a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume dc4a28a2-1361-497e-ba80-dc1f2705284d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4a28a2-1361-497e-ba80-dc1f2705284d', 'volume_size': 1} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-710238059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4a28a2-1361-497e-ba80-dc1f2705284d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:40Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Creating volume dc4a28a2-1361-497e-ba80-dc1f2705284d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:40 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:40 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d 1073741824 Jul 09 15:26:40 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (45bff40a-8e24-47d4-88e8-1cad3b14f03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76bfb42-eee2-460b-b296-395b4229cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76bfb42-eee2-460b-b296-395b4229cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449166670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7313d3e-b647-4ebb-9ea8-3395607c9d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:41Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b186926-1216-41dd-ba5f-6acfdfbcfa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b186926-1216-41dd-ba5f-6acfdfbcfa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962a92b9-83c4-4137-bf85-b06962c67dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962a92b9-83c4-4137-bf85-b06962c67dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7313d3e-b647-4ebb-9ea8-3395607c9d7b', 'volume_name': 'volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf7dc4e-2a65-47d2-93d1-697483c6b7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf7dc4e-2a65-47d2-93d1-697483c6b7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f492375c-8cfc-4133-b1cb-746228af57f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume b7313d3e-b647-4ebb-9ea8-3395607c9d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b', 'volume_size': 1} Jul 09 15:26:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:41 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52" returned: 0 in 0.888s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:41 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52 Jul 09 15:26:41 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (1bba599c-4e5d-453b-a81b-89c897b7605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b1e892-f552-46f3-bf0a-56729973083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b1e892-f552-46f3-bf0a-56729973083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-625627571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d7a8a1-4a88-4309-ad21-68cd04d06797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:41Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cfff4db-8fb1-438f-96fa-d2d7442bc0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cfff4db-8fb1-438f-96fa-d2d7442bc0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a269ef12-b7d0-48c7-acd3-83459c2eab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a269ef12-b7d0-48c7-acd3-83459c2eab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d7a8a1-4a88-4309-ad21-68cd04d06797', 'volume_name': 'volume-28d7a8a1-4a88-4309-ad21-68cd04d06797', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c4d8b4-6e8d-4bef-99fa-42d29484db3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c4d8b4-6e8d-4bef-99fa-42d29484db3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b4a861-6949-4d76-bb1a-8b42beb100d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume 28d7a8a1-4a88-4309-ad21-68cd04d06797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d7a8a1-4a88-4309-ad21-68cd04d06797', 'volume_size': 1} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (4c99f901-c548-4a28-8be1-c18d421f849a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:41 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f6c41f-ea3e-4329-9327-254c881c5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d 1073741824" returned: 0 in 1.102s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f6c41f-ea3e-4329-9327-254c881c5e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1111142754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0c60d6-30d5-468d-b2c3-b2f0adacec20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:41Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d522d53-e285-4fe4-9692-0c2715db46ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d522d53-e285-4fe4-9692-0c2715db46ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f45a7c8-1dff-439f-a27d-0fde51189f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f45a7c8-1dff-439f-a27d-0fde51189f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0c60d6-30d5-468d-b2c3-b2f0adacec20', 'volume_name': 'volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab125831-6090-4274-b5b0-fa5f9a57a960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab125831-6090-4274-b5b0-fa5f9a57a960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb062fc5-2f8e-42d2-8fd0-c501eb23d67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume 5d0c60d6-30d5-468d-b2c3-b2f0adacec20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20', 'volume_size': 1} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:41 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d Jul 09 15:26:41 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:41 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-27631201-80ee-450b-9a05-c5d200271d52" returned: 0 in 0.782s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-27631201-80ee-450b-9a05-c5d200271d52" released by "delete_volume" :: held 1.735s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created reservations ['b1ce4a07-e1a7-4b6f-a807-a3de36cbec35', 'bd11f160-83e6-45cd-a872-2aa930ba9127', '50e1b482-1fbf-441f-a75f-cdeff0fa54f4', '2eb11936-acf7-40f3-8d7f-d052086548db'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:41 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:41 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (08645e53-e584-4f84-9bdb-215f3ec97f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40ed9ac-ba28-40c3-b2d4-23483a486650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40ed9ac-ba28-40c3-b2d4-23483a486650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556118904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2a9953-145a-48a0-865b-8b1e7b41b36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:42Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f22c11-652f-4add-b4a0-1033a31fffa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f22c11-652f-4add-b4a0-1033a31fffa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893aa8b0-afc6-4f0b-9145-c588e4874ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893aa8b0-afc6-4f0b-9145-c588e4874ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e2a9953-145a-48a0-865b-8b1e7b41b36d', 'volume_name': 'volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d230c2d2-ba73-457f-90bc-98526da74326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d230c2d2-ba73-457f-90bc-98526da74326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e460be90-1810-4fe4-8cc1-64053baec0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume 2e2a9953-145a-48a0-865b-8b1e7b41b36d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d', 'volume_size': 1} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-8d2511b4-2969-485e-8603-1df981a44c8b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-8d2511b4-2969-485e-8603-1df981a44c8b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-quobyte-8d2511b4-2969-485e-8603-1df981a44c8b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-8d2511b4-2969-485e-8603-1df981a44c8b" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:42 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d" returned: 0 in 0.713s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd57c2-bfbe-445e-8b44-41a80f3eedcf]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449166670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7313d3e-b647-4ebb-9ea8-3395607c9d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:41Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Creating volume b7313d3e-b647-4ebb-9ea8-3395607c9d7b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:42 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:42 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b 1073741824 Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d11264-3390-4f97-aef9-239d072146a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4a28a2-1361-497e-ba80-dc1f2705284d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:42 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5db932-1a26-4042-9ede-0fe02a71dd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:42 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume volume-dc4a28a2-1361-497e-ba80-dc1f2705284d (dc4a28a2-1361-497e-ba80-dc1f2705284d): created successfully Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5db932-1a26-4042-9ede-0fe02a71dd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (c58050d2-d256-4c09-8829-3180a03e62f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cf4ebe51-666e-4218-a1c1-34911d78537b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created volume successfully. Jul 09 15:26:42 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b Jul 09 15:26:42 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:42 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.692s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:42 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Deleted volume successfully. Jul 09 15:26:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1491b8-b087-47dc-8fe9-70ccf54f6986 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-27631201-80ee-450b-9a05-c5d200271d52-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:43 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b" returned: 0 in 0.788s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:43 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b Jul 09 15:26:43 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:43 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b 1073741824" returned: 0 in 0.860s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:43 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b Jul 09 15:26:43 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:43 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8d2511b4-2969-485e-8603-1df981a44c8b" returned: 0 in 0.655s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-8d2511b4-2969-485e-8603-1df981a44c8b" released by "delete_volume" :: held 1.519s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created reservations ['c8b31073-5ba9-4d8c-9c3f-a5b74be545c8', '6104be2c-0de3-4a13-ac89-43c285fd11ad', 'c31d9934-953d-4e5a-b656-c79c54bbbadc', '6c093344-f2dc-4c54-9eb3-5d23492fb29a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:43 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b" returned: 0 in 0.688s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.668s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-625627571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d7a8a1-4a88-4309-ad21-68cd04d06797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:41Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Creating volume 28d7a8a1-4a88-4309-ad21-68cd04d06797 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:43 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:44 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797 1073741824 Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f492375c-8cfc-4133-b1cb-746228af57f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:44 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930ff5c1-dbe3-4c48-a32a-379e10768c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b (b7313d3e-b647-4ebb-9ea8-3395607c9d7b): created successfully Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930ff5c1-dbe3-4c48-a32a-379e10768c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:44 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (45bff40a-8e24-47d4-88e8-1cad3b14f03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:44 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5a817a85-7204-4307-985e-e8ff03957da1 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created volume successfully. Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "cinder-quobyte-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fa35af-bde0-4e15-b485-072bffe3b888]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:44 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c Jul 09 15:26:44 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:44 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.733s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Deleted volume successfully. Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-108245c0-0d40-4003-a17f-1350354dd43c tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-8d2511b4-2969-485e-8603-1df981a44c8b-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:44 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797 1073741824" returned: 0 in 0.931s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:44 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797 Jul 09 15:26:44 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:45 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c" returned: 0 in 0.763s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:45 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c Jul 09 15:26:45 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:45 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797" returned: 0 in 0.661s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.988s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1111142754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0c60d6-30d5-468d-b2c3-b2f0adacec20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:41Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Creating volume 5d0c60d6-30d5-468d-b2c3-b2f0adacec20 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:45 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b4a861-6949-4d76-bb1a-8b42beb100d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d7a8a1-4a88-4309-ad21-68cd04d06797', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:45 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20 1073741824 Jul 09 15:26:45 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f43f1ff-af82-4049-860d-80e461855a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume volume-28d7a8a1-4a88-4309-ad21-68cd04d06797 (28d7a8a1-4a88-4309-ad21-68cd04d06797): created successfully Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f43f1ff-af82-4049-860d-80e461855a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (1bba599c-4e5d-453b-a81b-89c897b7605c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-71234386-bbd7-45a8-b31b-fa4873b13171 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created volume successfully. Jul 09 15:26:46 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c" returned: 0 in 0.641s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-quobyte-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c" released by "delete_volume" :: held 1.449s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Created reservations ['087fe56f-f589-4a94-9383-8840ce149c74', 'd7174387-8b8a-4e5a-8593-a41366365524', '64d32a5c-ebb3-4ebc-9c13-e8a46f6518db', '78cf228f-b299-43b0-b096-c74f064f81fe'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:46 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:46 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:46 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20 1073741824" returned: 0 in 0.852s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:46 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20 Jul 09 15:26:46 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:46 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.698s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Deleted volume successfully. Jul 09 15:26:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a7956ba-2df9-454d-9916-651738b3d5b3 tempest-CreateVolumesFromSourceVolumeTest-1044737696 None] Lock "cinder-b9ddceaa-9ebc-4f0f-9d1f-944a31ea8c7c-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:47 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20" returned: 0 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.125s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556118904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2a9953-145a-48a0-865b-8b1e7b41b36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965fb083fac747ca8e28bc336f67b36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:42Z,use_quota=True,user_id='0c43033a400546a8b2ec732c17996c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Creating volume 2e2a9953-145a-48a0-865b-8b1e7b41b36d {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:47 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:47 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d 1073741824 Jul 09 15:26:47 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb062fc5-2f8e-42d2-8fd0-c501eb23d67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dab0bc-9772-4525-959e-d4124afe79a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20 (5d0c60d6-30d5-468d-b2c3-b2f0adacec20): created successfully Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dab0bc-9772-4525-959e-d4124afe79a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (4c99f901-c548-4a28-8be1-c18d421f849a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3486aad6-6247-45ed-ab8e-8729e6633a3f tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created volume successfully. Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:47 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:47 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:48 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d 1073741824" returned: 0 in 0.933s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:48 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d Jul 09 15:26:48 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:48 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.800s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:26:48 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d" returned: 0 in 0.689s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e460be90-1810-4fe4-8cc1-64053baec0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33baa848-6f2a-4983-83e4-1dfd3c252826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Volume volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d (2e2a9953-145a-48a0-865b-8b1e7b41b36d): created successfully Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33baa848-6f2a-4983-83e4-1dfd3c252826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Flow 'volume_create_manager' (08645e53-e584-4f84-9bdb-215f3ec97f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a22ef19f-4d46-4f0b-ac4c-a72feeacffd4 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created volume successfully. Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-2e2a9953-145a-48a0-865b-8b1e7b41b36d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-2e2a9953-145a-48a0-865b-8b1e7b41b36d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-quobyte-2e2a9953-145a-48a0-865b-8b1e7b41b36d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-2e2a9953-145a-48a0-865b-8b1e7b41b36d" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392b19c-54b5-4feb-9cac-d5be9c1663b8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Flow 'volume_create_manager' (6ce24681-0341-44c8-a3b8-d6294c8800a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fdb76c-bd04-45f0-be1e-0db3e674f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fdb76c-bd04-45f0-be1e-0db3e674f737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2049633116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a84efb-0bf2-4810-b6b3-e1993b0252c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5684914cdbf45a6a4ffd432749cdfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:50Z,use_quota=True,user_id='a92336413ccf4be892bdeff9894f8942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bedd6e-ac3b-4b76-bf58-14a4ef0f2ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bedd6e-ac3b-4b76-bf58-14a4ef0f2ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c3a7c2-2d70-4642-8fe5-1184de5cfdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c3a7c2-2d70-4642-8fe5-1184de5cfdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a84efb-0bf2-4810-b6b3-e1993b0252c1', 'volume_name': 'volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a06a335-5bd6-4026-922c-49c6715dfaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a06a335-5bd6-4026-922c-49c6715dfaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dff701-19b5-49cd-a431-7d48f6236742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Volume 01a84efb-0bf2-4810-b6b3-e1993b0252c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1', 'volume_size': 1} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2049633116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a84efb-0bf2-4810-b6b3-e1993b0252c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5684914cdbf45a6a4ffd432749cdfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:50Z,use_quota=True,user_id='a92336413ccf4be892bdeff9894f8942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Creating volume 01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:49 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:26:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:49 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d Jul 09 15:26:49 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:49 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 1073741824 Jul 09 15:26:49 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:50 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d" returned: 0 in 0.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:50 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d Jul 09 15:26:50 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:50 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 1073741824" returned: 0 in 0.872s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:50 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 Jul 09 15:26:50 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:51 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2e2a9953-145a-48a0-865b-8b1e7b41b36d" returned: 0 in 0.681s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-2e2a9953-145a-48a0-865b-8b1e7b41b36d" released by "delete_volume" :: held 1.558s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created reservations ['cae993da-5a33-4840-bc31-d8ad104a02a7', 'cc231780-af68-4fc7-a3be-d46782065074', 'e66e5b34-2a61-445b-b25b-12f8c225a214', 'f395bc8d-5d9d-473d-84ac-f3579534f5b8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:51 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:51 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:51 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1" returned: 0 in 0.692s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dff701-19b5-49cd-a431-7d48f6236742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2246428-be5a-4ed1-9bef-c66557d12f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:51 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Volume volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 (01a84efb-0bf2-4810-b6b3-e1993b0252c1): created successfully Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2246428-be5a-4ed1-9bef-c66557d12f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Flow 'volume_create_manager' (6ce24681-0341-44c8-a3b8-d6294c8800a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-93413010-42bd-4bf0-a232-935a3a093877 tempest-VolumeDependencyTests-1267776525 None] Created volume successfully. Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-5d0c60d6-30d5-468d-b2c3-b2f0adacec20-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-5d0c60d6-30d5-468d-b2c3-b2f0adacec20-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-quobyte-5d0c60d6-30d5-468d-b2c3-b2f0adacec20" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-5d0c60d6-30d5-468d-b2c3-b2f0adacec20" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e12785-c043-48b0-8cb2-adb7cafbba7c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Creating offline snapshot 55f849fe-de34-42ac-a721-4266cb0252a3 of volume 01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb116d66-5e64-43bd-ae18-a67fccfe4771]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:52 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.739s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Deleted volume successfully. Jul 09 15:26:52 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20 Jul 09 15:26:52 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-353b46c0-ae04-452e-9161-961077a5ed4e tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-2e2a9953-145a-48a0-865b-8b1e7b41b36d-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:52 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 Jul 09 15:26:52 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:52 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20" returned: 0 in 0.794s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:52 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20 Jul 09 15:26:52 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:52 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1" returned: 0 in 0.803s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:52 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 1G Jul 09 15:26:52 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:53 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5d0c60d6-30d5-468d-b2c3-b2f0adacec20" returned: 0 in 0.667s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-5d0c60d6-30d5-468d-b2c3-b2f0adacec20" released by "delete_volume" :: held 1.525s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created reservations ['da5328d7-116b-4dbf-b5cb-2551627a44a2', '2e5848a8-5ff3-4034-9088-f1a15ad70c03', 'bef126be-0fcd-4192-852e-2be473ab8f0c', '6b7ff463-fbdf-4087-b63c-071473eaf13b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:53 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:53 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:53 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 1G" returned: 0 in 0.820s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:53 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 Jul 09 15:26:53 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-28d7a8a1-4a88-4309-ad21-68cd04d06797-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-28d7a8a1-4a88-4309-ad21-68cd04d06797-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-quobyte-28d7a8a1-4a88-4309-ad21-68cd04d06797" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-28d7a8a1-4a88-4309-ad21-68cd04d06797" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e1282c-7607-4b37-80ed-b3f669f34ce3]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:54 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.692s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Deleted volume successfully. Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c1d531af-7e5f-47a0-adba-3882456946b7 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-5d0c60d6-30d5-468d-b2c3-b2f0adacec20-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:54 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797 Jul 09 15:26:54 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:54 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3" returned: 0 in 0.757s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:54 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 is being set with open permissions: ugo+rw Jul 09 15:26:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:54 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 Jul 09 15:26:54 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:55 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797" returned: 0 in 0.784s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:55 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797 Jul 09 15:26:55 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:55 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3" returned: 0 in 0.648s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:55 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.info Jul 09 15:26:55 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:55 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-28d7a8a1-4a88-4309-ad21-68cd04d06797" returned: 0 in 0.659s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-28d7a8a1-4a88-4309-ad21-68cd04d06797" released by "delete_volume" :: held 1.486s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created reservations ['081e1d9c-af21-41d2-b1e6-de43b2ee5d81', 'e7b6d5a5-dbaf-40fc-a33c-ec5da4b3ef2f', 'f9b5c4ea-04a6-4041-b095-ba3bdbb814f3', '74599b12-d067-4087-bb89-78946a98b80a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:55 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.info" returned: 0 in 0.656s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:55 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.info is being set with open permissions: ugo+rw Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:55 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.info Jul 09 15:26:55 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:55 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:55 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-b7313d3e-b647-4ebb-9ea8-3395607c9d7b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-b7313d3e-b647-4ebb-9ea8-3395607c9d7b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:56 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.info" returned: 0 in 0.661s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.435s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:56 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.654s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Deleted volume successfully. Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-quobyte-b7313d3e-b647-4ebb-9ea8-3395607c9d7b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0abf0c61-af79-42d2-a746-8cc4c3d972c3 tempest-VolumeDependencyTests-1267776525 None] Create snapshot completed successfully Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-b7313d3e-b647-4ebb-9ea8-3395607c9d7b" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8431f960-f535-477a-a757-c1fe13cb3d95 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-28d7a8a1-4a88-4309-ad21-68cd04d06797-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c192533e-cca7-46e9-855f-9e27940abd8e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:56 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b Jul 09 15:26:56 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:57 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b" returned: 0 in 0.749s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:57 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b Jul 09 15:26:57 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Flow 'volume_create_manager' (dcc1f7de-32b0-4d5b-b2f2-e93c794ddfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53ad0e0-3378-4edc-a7f8-b545605c9f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53ad0e0-3378-4edc-a7f8-b545605c9f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-101541046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4368befd-c189-4712-b525-701fcb050ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5684914cdbf45a6a4ffd432749cdfdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55f849fe-de34-42ac-a721-4266cb0252a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:26:58Z,use_quota=True,user_id='a92336413ccf4be892bdeff9894f8942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b5be39-8a80-41ec-8940-4d37b4cb6db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b5be39-8a80-41ec-8940-4d37b4cb6db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1aa2f66-f227-4548-990d-1c8d0f637a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1aa2f66-f227-4548-990d-1c8d0f637a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4368befd-c189-4712-b525-701fcb050ddb', 'volume_name': 'volume-4368befd-c189-4712-b525-701fcb050ddb', 'volume_size': 1, 'snapshot_id': '55f849fe-de34-42ac-a721-4266cb0252a3'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52537f5b-c97a-4f35-89ce-7638775563dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52537f5b-c97a-4f35-89ce-7638775563dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca7d650-e1d8-4a49-8ead-5f3c99cdc333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:26:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Volume 4368befd-c189-4712-b525-701fcb050ddb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4368befd-c189-4712-b525-701fcb050ddb', 'volume_size': 1, 'snapshot_id': '55f849fe-de34-42ac-a721-4266cb0252a3'} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "cinder-quobyte-55f849fe-de34-42ac-a721-4266cb0252a3-4368befd-c189-4712-b525-701fcb050ddb" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-55f849fe-de34-42ac-a721-4266cb0252a3-4368befd-c189-4712-b525-701fcb050ddb" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Creating volume 4368befd-c189-4712-b525-701fcb050ddb from snapshot 55f849fe-de34-42ac-a721-4266cb0252a3 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "cinder-quobyte-4368befd-c189-4712-b525-701fcb050ddb" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-4368befd-c189-4712-b525-701fcb050ddb" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] snapshot: 55f849fe-de34-42ac-a721-4266cb0252a3, volume: 4368befd-c189-4712-b525-701fcb050ddb, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:57 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b7313d3e-b647-4ebb-9ea8-3395607c9d7b" returned: 0 in 0.674s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f343fe-3edf-4d7d-a654-9a08746d0971]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-b7313d3e-b647-4ebb-9ea8-3395607c9d7b" released by "delete_volume" :: held 1.473s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created reservations ['ae358736-1a49-41d0-bab1-9ed93972d6a4', 'da6acbbe-f1d2-4451-a847-7f54734fe911', '5bdf2ef0-45a4-4eed-bbbd-3adedd0f5c85', 'ebfb94f3-fa57-4eb8-8da2-5057c93ae0eb'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:26:58 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 Jul 09 15:26:58 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:58 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:26:58 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-dc4a28a2-1361-497e-ba80-dc1f2705284d-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-dc4a28a2-1361-497e-ba80-dc1f2705284d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-quobyte-dc4a28a2-1361-497e-ba80-dc1f2705284d" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-dc4a28a2-1361-497e-ba80-dc1f2705284d" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:26:58 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.690s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:26:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Deleted volume successfully. Jul 09 15:26:58 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f65f5b-2e8d-49e1-92c6-8aeb4a3718c4]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3" returned: 0 in 0.861s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5b3b7710-f191-45ec-826c-394846c0b0da tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-b7313d3e-b647-4ebb-9ea8-3395607c9d7b-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[748b29d4-3f1b-4986-abda-8e36e78d83a1]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:26:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:58 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d Jul 09 15:26:58 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:59 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 Jul 09 15:26:59 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:59 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d" returned: 0 in 0.766s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:59 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d Jul 09 15:26:59 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:26:59 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jul 09 15:26:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1" returned: 0 in 0.793s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:26:59 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:26:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:26:59 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb Jul 09 15:26:59 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:00 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-dc4a28a2-1361-497e-ba80-dc1f2705284d" returned: 0 in 0.659s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-dc4a28a2-1361-497e-ba80-dc1f2705284d" released by "delete_volume" :: held 1.496s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created reservations ['a8722899-9e2d-4d54-8a5c-348e831cd2f0', 'ef676c34-749f-4ed8-8250-cbc57fc37d5c', '8069057f-4c22-40b7-ac75-5c6eb1422ac9', 'a6f0d336-bc88-4b6f-a35c-28c6787f37f5'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:00 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:27:00 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-db44bfc1-93cc-49d2-b356-5097544472a2-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-db44bfc1-93cc-49d2-b356-5097544472a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-quobyte-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-quobyte-db44bfc1-93cc-49d2-b356-5097544472a2" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-db44bfc1-93cc-49d2-b356-5097544472a2" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Deleting offline snapshot db44bfc1-93cc-49d2-b356-5097544472a2 of volume 1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] snapshot_file for this snap is: volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aff7da6-b147-4dd1-a687-1b01568529e7]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:01 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 Jul 09 15:27:01 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:01 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.381s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Deleted volume successfully. Jul 09 15:27:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0b1e3a08-04a1-4b23-997b-434a148e8221 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-dc4a28a2-1361-497e-ba80-dc1f2705284d-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:02 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2" returned: 0 in 1.277s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:27:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[152b26ab-3d0d-4a73-8bfd-90b94bf8f7ce]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:02 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 Jul 09 15:27:02 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:04 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" returned: 0 in 1.600s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:04 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 Jul 09 15:27:04 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:05 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb" returned: 0 in 5.337s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[05401977-4150-44f7-a164-1721a1854835]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:05 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 Jul 09 15:27:05 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:05 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2" returned: 0 in 1.122s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:05 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2 Jul 09 15:27:05 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:06 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1" returned: 0 in 0.985s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:27:06 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Converted 1024.00 MB image at 191.82 MB/s Jul 09 15:27:06 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb is being set with open permissions: ugo+rw Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:06 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb Jul 09 15:27:06 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:06 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2.db44bfc1-93cc-49d2-b356-5097544472a2" returned: 0 in 0.677s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-db44bfc1-93cc-49d2-b356-5097544472a2" released by "_delete_snapshot" :: held 4.872s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" released by "delete_snapshot" :: held 4.927s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created reservations ['4df82da6-06cc-4e49-a305-3b13c4d1b787', '54bd8b42-e1ef-423d-97ed-34178666b7a7', 'df0bc74a-4ff9-40e0-b65b-83fd01901b49', 'fd827066-0369-48d9-969c-dd8a0d59435d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Delete snapshot completed successfully. Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8a990fc7-bb22-483d-aeef-e1ba7db7b90b tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-db44bfc1-93cc-49d2-b356-5097544472a2-delete_snapshot" released by "delete_snapshot" :: held 5.076s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:06 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb" returned: 0 in 0.643s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-4368befd-c189-4712-b525-701fcb050ddb" released by "_copy_volume_from_snapshot" :: held 8.719s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-55f849fe-de34-42ac-a721-4266cb0252a3-4368befd-c189-4712-b525-701fcb050ddb" released by "_create_volume_from_snapshot" :: held 8.752s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.773s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca7d650-e1d8-4a49-8ead-5f3c99cdc333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4368befd-c189-4712-b525-701fcb050ddb', 'volume_size': 1, 'snapshot_id': '55f849fe-de34-42ac-a721-4266cb0252a3'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f24c125-463c-40bd-aee8-d54564fadd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Volume volume-4368befd-c189-4712-b525-701fcb050ddb (4368befd-c189-4712-b525-701fcb050ddb): created successfully Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f24c125-463c-40bd-aee8-d54564fadd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Flow 'volume_create_manager' (dcc1f7de-32b0-4d5b-b2f2-e93c794ddfee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-deed9751-bdba-4f4e-a54c-e3879adec407 tempest-VolumeDependencyTests-1267776525 None] Created volume successfully. Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "cinder-quobyte-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a733e6-b807-4197-b16a-e7fd654215b8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:06 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 Jul 09 15:27:06 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:07 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" returned: 0 in 0.754s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:07 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2 Jul 09 15:27:07 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "cinder-55f849fe-de34-42ac-a721-4266cb0252a3-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-55f849fe-de34-42ac-a721-4266cb0252a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "cinder-quobyte-01a84efb-0bf2-4810-b6b3-e1993b0252c1" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-01a84efb-0bf2-4810-b6b3-e1993b0252c1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "cinder-quobyte-55f849fe-de34-42ac-a721-4266cb0252a3" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-55f849fe-de34-42ac-a721-4266cb0252a3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Deleting offline snapshot 55f849fe-de34-42ac-a721-4266cb0252a3 of volume 01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] snapshot_file for this snap is: volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[005e19bd-77fc-45ed-b3ed-aaf1761d9f9c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:08 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 Jul 09 15:27:08 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:08 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" returned: 0 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-quobyte-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2" released by "delete_volume" :: held 1.461s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Created reservations ['0b7a2b83-a43f-4797-a1fc-bf1661191121', '196fb619-5834-4ba9-b090-f938b50d8e8d', 'bcb6a0d0-8bbc-4c69-b3d0-1255af687fe9', '46b261f7-c2c1-490f-80ff-ae86f8c123d6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:08 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:27:08 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:08 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3" returned: 0 in 0.807s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e3fc98-9fc5-402d-b84e-1f34aa2d8858]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:08 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 Jul 09 15:27:08 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:09 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.676s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:09 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Deleted volume successfully. Jul 09 15:27:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-5625b6ef-d6c6-40d4-b5b5-f9bd4a475df2 tempest-CreateVolumesFromSnapshotTest-1186558147 None] Lock "cinder-1f0a1252-dec8-4602-9c3f-d2bcaa2aa7e2-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:09 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1" returned: 0 in 0.774s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:09 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 Jul 09 15:27:09 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:10 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3" returned: 0 in 0.788s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:10 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3 Jul 09 15:27:10 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:11 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1.55f849fe-de34-42ac-a721-4266cb0252a3" returned: 0 in 0.659s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-55f849fe-de34-42ac-a721-4266cb0252a3" released by "_delete_snapshot" :: held 3.135s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-01a84efb-0bf2-4810-b6b3-e1993b0252c1" released by "delete_snapshot" :: held 3.158s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:11 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Created reservations ['987f7ba8-3599-4216-9602-0c5a5846fa77', '485e4afe-0809-4c7c-9365-0b90f47e81f3', '2c28b539-3f55-44f8-996a-da551f028c91', '091198be-fb9d-498f-8990-580a8c42548a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Delete snapshot completed successfully. Jul 09 15:27:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-07e3fb3f-e866-4753-9ef3-b6e0562e3765 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-55f849fe-de34-42ac-a721-4266cb0252a3-delete_snapshot" released by "delete_snapshot" :: held 3.309s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "cinder-01a84efb-0bf2-4810-b6b3-e1993b0252c1-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-01a84efb-0bf2-4810-b6b3-e1993b0252c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "cinder-quobyte-01a84efb-0bf2-4810-b6b3-e1993b0252c1" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-01a84efb-0bf2-4810-b6b3-e1993b0252c1" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e8ed64-b785-429a-81a6-a4c013ea0ea3]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:12 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 Jul 09 15:27:12 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Flow 'volume_create_manager' (9ddd5b3d-a138-4c0d-952e-4e0f75aa4396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b3af4a-125c-4cf3-a112-4b8b745cdb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b3af4a-125c-4cf3-a112-4b8b745cdb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922625645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d543bde9-c57c-4ba1-9fa9-a36fdac00846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1591f588904c28b27737a205c9c0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:12Z,use_quota=True,user_id='7e372e83783145b29f1c3bb7fbdb9b25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db82e6ea-00c7-41a1-8277-54456eff65fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db82e6ea-00c7-41a1-8277-54456eff65fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980572e1-d303-4227-a0dc-70e7109778f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980572e1-d303-4227-a0dc-70e7109778f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd543bde9-c57c-4ba1-9fa9-a36fdac00846', 'volume_name': 'volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4ae3ca-06fb-4a2b-9584-9de2b39f8b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4ae3ca-06fb-4a2b-9584-9de2b39f8b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fe64bf-63c8-4c58-bba5-8be8f03fae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:12 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Volume d543bde9-c57c-4ba1-9fa9-a36fdac00846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846', 'volume_size': 1} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922625645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d543bde9-c57c-4ba1-9fa9-a36fdac00846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1591f588904c28b27737a205c9c0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:12Z,use_quota=True,user_id='7e372e83783145b29f1c3bb7fbdb9b25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Creating volume d543bde9-c57c-4ba1-9fa9-a36fdac00846 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:12 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:27:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:12 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846 1073741824 Jul 09 15:27:12 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:13 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:13 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1 Jul 09 15:27:13 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:13 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846 1073741824" returned: 0 in 0.924s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:13 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846 Jul 09 15:27:13 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:13 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-01a84efb-0bf2-4810-b6b3-e1993b0252c1" returned: 0 in 0.680s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-01a84efb-0bf2-4810-b6b3-e1993b0252c1" released by "delete_volume" :: held 1.516s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Created reservations ['e5c2b47e-11ec-4116-a2cb-0901668c2f85', '1fa06d42-46cc-404a-bcf0-c5ec6cafbb8e', 'fb6113e6-65e6-4361-9f09-1cc21462858d', '4a276681-dbdd-4022-92c9-75ce298cd093'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=199,cinder:DELETE=25,cinder:SELECT=139,cinder:INSERT=43 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:13 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:27:13 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:14 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846" returned: 0 in 0.684s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fe64bf-63c8-4c58-bba5-8be8f03fae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7980d454-df59-468a-b108-b40e77b5ba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Volume volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846 (d543bde9-c57c-4ba1-9fa9-a36fdac00846): created successfully Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7980d454-df59-468a-b108-b40e77b5ba4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Flow 'volume_create_manager' (9ddd5b3d-a138-4c0d-952e-4e0f75aa4396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5f2eace5-9638-411c-bbbb-1dd408a5c20b tempest-ProjectReaderTests-531094401 None] Created volume successfully. Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "cinder-4368befd-c189-4712-b525-701fcb050ddb-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-4368befd-c189-4712-b525-701fcb050ddb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "cinder-quobyte-4368befd-c189-4712-b525-701fcb050ddb" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-4368befd-c189-4712-b525-701fcb050ddb" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f13a64-ae2b-4d09-9e5a-103c68da4b18]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:14 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.682s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Deleted volume successfully. Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a336e4bd-e091-4e7e-bd90-7bb88f0e8b4a tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-01a84efb-0bf2-4810-b6b3-e1993b0252c1-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:14 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb Jul 09 15:27:14 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Acquiring lock "cinder-d543bde9-c57c-4ba1-9fa9-a36fdac00846-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Lock "cinder-d543bde9-c57c-4ba1-9fa9-a36fdac00846-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Acquiring lock "cinder-quobyte-d543bde9-c57c-4ba1-9fa9-a36fdac00846" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Lock "cinder-quobyte-d543bde9-c57c-4ba1-9fa9-a36fdac00846" acquired by "delete_volume" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[536a74c2-8325-463e-ad46-cf8e262650df]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:14 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846 Jul 09 15:27:14 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:15 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb" returned: 0 in 0.778s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:15 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb Jul 09 15:27:15 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:15 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846" returned: 0 in 0.764s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:15 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846 Jul 09 15:27:15 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:16 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4368befd-c189-4712-b525-701fcb050ddb" returned: 0 in 0.650s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-quobyte-4368befd-c189-4712-b525-701fcb050ddb" released by "delete_volume" :: held 1.475s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Created reservations ['e04911fe-7594-43f3-a61f-f34690814eb1', 'fa25aa76-029d-46b4-923f-fd4bea2a9a52', '1634c1c6-1c24-4f15-9e46-814dbbbef71a', 'c79061eb-b99f-4e30-bf81-e894494fccde'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:16 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:27:16 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:16 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d543bde9-c57c-4ba1-9fa9-a36fdac00846" returned: 0 in 0.636s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Lock "cinder-quobyte-d543bde9-c57c-4ba1-9fa9-a36fdac00846" released by "delete_volume" :: held 1.446s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Created reservations ['d77ac35a-8ed0-496f-8fd7-8ef8f26c85f6', '97313f09-8220-4f87-a347-702d55d1569b', 'b1a3bb47-c46d-448e-bf4b-446b369cb881', '72c015cf-658c-4380-a388-d3258f7481f4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:16 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:27:16 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:16 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.673s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Deleted volume successfully. Jul 09 15:27:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fc436d21-43de-4e69-a41c-939fc2cbd399 tempest-VolumeDependencyTests-1267776525 None] Lock "cinder-4368befd-c189-4712-b525-701fcb050ddb-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:17 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.698s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Deleted volume successfully. Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-73ba8166-9f8f-4ecb-93cd-1024a9ae721b tempest-ProjectReaderTests-531094401 None] Lock "cinder-d543bde9-c57c-4ba1-9fa9-a36fdac00846-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Flow 'volume_create_manager' (dfe5f78f-338a-49a8-bb96-8f7520ec6f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4022dbd1-b569-493d-979f-0eb95538a8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4022dbd1-b569-493d-979f-0eb95538a8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39380062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c66e38-1906-4519-b17f-3ea5fbd101ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1591f588904c28b27737a205c9c0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:17Z,use_quota=True,user_id='7e372e83783145b29f1c3bb7fbdb9b25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d55402a-cca8-4ad2-92a0-05965087bdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d55402a-cca8-4ad2-92a0-05965087bdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73fed01-c382-4b98-b243-c0d7c199eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73fed01-c382-4b98-b243-c0d7c199eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c66e38-1906-4519-b17f-3ea5fbd101ce', 'volume_name': 'volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d47b132-54e3-4ff4-afe4-95ce5e23ab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d47b132-54e3-4ff4-afe4-95ce5e23ab93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9174fe-48fa-4886-95db-e8330bff08e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Volume a3c66e38-1906-4519-b17f-3ea5fbd101ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce', 'volume_size': 1} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39380062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c66e38-1906-4519-b17f-3ea5fbd101ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1591f588904c28b27737a205c9c0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:17Z,use_quota=True,user_id='7e372e83783145b29f1c3bb7fbdb9b25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Creating volume a3c66e38-1906-4519-b17f-3ea5fbd101ce {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:17 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:27:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:17 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce 1073741824 Jul 09 15:27:17 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:18 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce 1073741824" returned: 0 in 0.884s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:18 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce Jul 09 15:27:18 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:19 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce" returned: 0 in 0.640s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9174fe-48fa-4886-95db-e8330bff08e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2458fa61-fbf1-42b8-8fa6-299f0bd512e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Volume volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce (a3c66e38-1906-4519-b17f-3ea5fbd101ce): created successfully Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2458fa61-fbf1-42b8-8fa6-299f0bd512e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Flow 'volume_create_manager' (dfe5f78f-338a-49a8-bb96-8f7520ec6f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b47cd688-4503-4e2a-ba3c-27b57ac0df0f tempest-ProjectReaderTests-531094401 None] Created volume successfully. Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Acquiring lock "cinder-a3c66e38-1906-4519-b17f-3ea5fbd101ce-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Lock "cinder-a3c66e38-1906-4519-b17f-3ea5fbd101ce-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Acquiring lock "cinder-quobyte-a3c66e38-1906-4519-b17f-3ea5fbd101ce" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Lock "cinder-quobyte-a3c66e38-1906-4519-b17f-3ea5fbd101ce" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fc64f9-3486-41ac-bd22-2facac755651]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:19 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce Jul 09 15:27:19 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:20 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce" returned: 0 in 0.737s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:20 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce Jul 09 15:27:20 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:20 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-a3c66e38-1906-4519-b17f-3ea5fbd101ce" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Lock "cinder-quobyte-a3c66e38-1906-4519-b17f-3ea5fbd101ce" released by "delete_volume" :: held 1.405s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:20 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=215,cinder:SELECT=144,cinder:INSERT=55,cinder:DELETE=11 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:27:21 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Created reservations ['5b14ae29-a88b-4d41-b864-9177d378264e', '3cc92be5-0f88-42c6-97b2-36dbb46569d2', '26768542-7d5f-45e7-a250-1bab509fcf7a', '39ef9ddf-ef50-4f6e-886d-6c1ec402fa77'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:27:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:21 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:27:21 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:21 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.633s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Deleted volume successfully. Jul 09 15:27:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2d459be3-808a-40c9-8ca0-4e9330740dff tempest-ProjectReaderTests-531094401 None] Lock "cinder-a3c66e38-1906-4519-b17f-3ea5fbd101ce-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:27:31 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=2,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:27:31 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=30,cinder:SELECT=20,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Flow 'volume_create_manager' (f96f2bfc-6448-4766-bbd0-8e14cb56c71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5ec1b4-615a-46ca-9a49-807e962d30ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5ec1b4-615a-46ca-9a49-807e962d30ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-143171117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f67a9cf-3aea-423b-a6a3-45f916a076ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32b905af62948d7a644589dfb6f5dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:46Z,use_quota=True,user_id='8cedfc8c953e4b8dbb3b6aa1d8b57db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd33c76-a2d1-4aa8-8cfc-6f0419e656df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd33c76-a2d1-4aa8-8cfc-6f0419e656df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e57c79a-4bb5-415b-9fe3-6f35b41258d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e57c79a-4bb5-415b-9fe3-6f35b41258d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f67a9cf-3aea-423b-a6a3-45f916a076ac', 'volume_name': 'volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51eee2c9-5333-4e7f-b797-43fa4a67fc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51eee2c9-5333-4e7f-b797-43fa4a67fc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6519fefe-b885-427d-9140-16b957793ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Volume 2f67a9cf-3aea-423b-a6a3-45f916a076ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac', 'volume_size': 1} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-143171117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f67a9cf-3aea-423b-a6a3-45f916a076ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32b905af62948d7a644589dfb6f5dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:46Z,use_quota=True,user_id='8cedfc8c953e4b8dbb3b6aa1d8b57db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Creating volume 2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:45 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:27:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:45 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac 1073741824 Jul 09 15:27:45 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:46 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac 1073741824" returned: 0 in 0.779s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:46 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac Jul 09 15:27:46 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:47 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac" returned: 0 in 0.665s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6519fefe-b885-427d-9140-16b957793ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0482cb6c-b974-43b2-8a1b-7c8138878426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Volume volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac (2f67a9cf-3aea-423b-a6a3-45f916a076ac): created successfully Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0482cb6c-b974-43b2-8a1b-7c8138878426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Flow 'volume_create_manager' (f96f2bfc-6448-4766-bbd0-8e14cb56c71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:47 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-05b3c2ff-52f3-4fee-9ee1-3866f843ecaa tempest-SnapshotDependencyTests-1113021944 None] Created volume successfully. Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:47 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:27:47 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Creating offline snapshot fcff6d0c-3fdb-494a-8734-2c775125e1c2 of volume 2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5c7cd3-fa7c-4ed0-b93e-dbafd94a4e25]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:48 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac Jul 09 15:27:48 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:48 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:27:48 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac" returned: 0 in 0.772s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:49 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 1G Jul 09 15:27:49 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:49 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 1G" returned: 0 in 0.780s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:49 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 Jul 09 15:27:49 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:50 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2" returned: 0 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:50 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 is being set with open permissions: ugo+rw Jul 09 15:27:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:50 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 Jul 09 15:27:50 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:51 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2" returned: 0 in 0.647s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:51 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.info Jul 09 15:27:51 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:51 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.info" returned: 0 in 0.633s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:51 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.info is being set with open permissions: ugo+rw Jul 09 15:27:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:51 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.info Jul 09 15:27:51 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:52 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.info" returned: 0 in 0.639s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.213s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e43b44bb-da77-4e36-9732-d8baa9dd1914 tempest-SnapshotDependencyTests-1113021944 None] Create snapshot completed successfully Jul 09 15:27:53 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:27:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Flow 'volume_create_manager' (598af865-e7ef-4215-a04b-ca552f04774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:27:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c0b206-c08c-4bee-b1d0-c4482817fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c0b206-c08c-4bee-b1d0-c4482817fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87eaf391-b987-4ae4-bc38-4c4318bfb4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32b905af62948d7a644589dfb6f5dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fcff6d0c-3fdb-494a-8734-2c775125e1c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:27:54Z,use_quota=True,user_id='8cedfc8c953e4b8dbb3b6aa1d8b57db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bc2b90-8054-40f6-a131-cda8dfa3278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bc2b90-8054-40f6-a131-cda8dfa3278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3126d755-f42a-4ba9-84f5-e1e29d811943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3126d755-f42a-4ba9-84f5-e1e29d811943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '87eaf391-b987-4ae4-bc38-4c4318bfb4ba', 'volume_name': 'volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba', 'volume_size': 1, 'snapshot_id': 'fcff6d0c-3fdb-494a-8734-2c775125e1c2'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e40d24-efe4-4c37-b134-726a86ec8921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e40d24-efe4-4c37-b134-726a86ec8921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58046c8f-c928-4409-aa77-9f84a3ec8b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:27:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Volume 87eaf391-b987-4ae4-bc38-4c4318bfb4ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba', 'volume_size': 1, 'snapshot_id': 'fcff6d0c-3fdb-494a-8734-2c775125e1c2'} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "cinder-quobyte-fcff6d0c-3fdb-494a-8734-2c775125e1c2-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-fcff6d0c-3fdb-494a-8734-2c775125e1c2-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Creating volume 87eaf391-b987-4ae4-bc38-4c4318bfb4ba from snapshot fcff6d0c-3fdb-494a-8734-2c775125e1c2 {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "cinder-quobyte-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] snapshot: fcff6d0c-3fdb-494a-8734-2c775125e1c2, volume: 87eaf391-b987-4ae4-bc38-4c4318bfb4ba, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[213e1d76-7b39-4613-9c97-57237f0b1fc5]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:54 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 Jul 09 15:27:54 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:54 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2" returned: 0 in 0.751s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a40164-956e-447d-b231-5e8fed2214be]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:54 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac Jul 09 15:27:54 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:55 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac" returned: 0 in 0.730s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:55 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:27:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:27:55 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba Jul 09 15:27:55 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:27:59 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 09 15:27:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" returned: 0 in 4.356s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:27:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ac7a3b-9de5-46e8-a433-e5629ad5a439]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:27:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:00 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac Jul 09 15:28:00 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:00 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac" returned: 0 in 0.893s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:00 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:28:00 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Converted 1024.00 MB image at 234.96 MB/s Jul 09 15:28:00 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba is being set with open permissions: ugo+rw Jul 09 15:28:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:00 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba Jul 09 15:28:00 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:01 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" returned: 0 in 0.646s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" released by "_copy_volume_from_snapshot" :: held 7.467s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-fcff6d0c-3fdb-494a-8734-2c775125e1c2-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" released by "_create_volume_from_snapshot" :: held 7.496s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.512s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58046c8f-c928-4409-aa77-9f84a3ec8b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba', 'volume_size': 1, 'snapshot_id': 'fcff6d0c-3fdb-494a-8734-2c775125e1c2'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee21a681-e62e-46af-a645-695c96212938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:01 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Volume volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba (87eaf391-b987-4ae4-bc38-4c4318bfb4ba): created successfully Jul 09 15:28:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee21a681-e62e-46af-a645-695c96212938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:01 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Flow 'volume_create_manager' (598af865-e7ef-4215-a04b-ca552f04774b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-267c4db5-4cbd-493e-9465-36dacb1547c5 tempest-SnapshotDependencyTests-1113021944 None] Created volume successfully. Jul 09 15:28:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "cinder-fcff6d0c-3fdb-494a-8734-2c775125e1c2-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-fcff6d0c-3fdb-494a-8734-2c775125e1c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "cinder-quobyte-2f67a9cf-3aea-423b-a6a3-45f916a076ac" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-2f67a9cf-3aea-423b-a6a3-45f916a076ac" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "cinder-quobyte-fcff6d0c-3fdb-494a-8734-2c775125e1c2" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-fcff6d0c-3fdb-494a-8734-2c775125e1c2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Deleting offline snapshot fcff6d0c-3fdb-494a-8734-2c775125e1c2 of volume 2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:28:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] snapshot_file for this snap is: volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:28:02 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9ed9b2-9630-4dc5-a98d-e98a8b8559b3]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:02 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 Jul 09 15:28:02 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:03 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2" returned: 0 in 0.792s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:28:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a92b36-acb0-4ed9-b148-c8e59585d831]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:03 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac Jul 09 15:28:03 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:04 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac" returned: 0 in 0.756s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:04 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 Jul 09 15:28:04 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:04 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2" returned: 0 in 0.719s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:05 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2 Jul 09 15:28:05 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:05 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac.fcff6d0c-3fdb-494a-8734-2c775125e1c2" returned: 0 in 0.616s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-fcff6d0c-3fdb-494a-8734-2c775125e1c2" released by "_delete_snapshot" :: held 2.981s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-2f67a9cf-3aea-423b-a6a3-45f916a076ac" released by "delete_snapshot" :: held 3.005s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Created reservations ['c3d72f67-da8e-4683-bfaf-c1a2c6d7b720', 'd3480b96-7783-40aa-9f49-d0d56441e134', '20c95840-c139-4600-a0f4-4e450c951bb6', '69a54db1-a622-4f17-9069-da0d2e68d965'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Delete snapshot completed successfully. Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9051bac-042b-4579-b601-ca6004ff8b2f tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-fcff6d0c-3fdb-494a-8734-2c775125e1c2-delete_snapshot" released by "delete_snapshot" :: held 3.144s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "cinder-2f67a9cf-3aea-423b-a6a3-45f916a076ac-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-2f67a9cf-3aea-423b-a6a3-45f916a076ac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "cinder-quobyte-2f67a9cf-3aea-423b-a6a3-45f916a076ac" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-2f67a9cf-3aea-423b-a6a3-45f916a076ac" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c225e329-18f7-414e-81c0-4ff9cfb44bda]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:06 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac Jul 09 15:28:06 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:06 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac" returned: 0 in 0.721s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:06 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac Jul 09 15:28:06 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:07 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-2f67a9cf-3aea-423b-a6a3-45f916a076ac" returned: 0 in 0.663s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-2f67a9cf-3aea-423b-a6a3-45f916a076ac" released by "delete_volume" :: held 1.439s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:07 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Created reservations ['7c6043b0-f33f-496e-b703-01af6d77f446', '023c2f66-aba1-4b0d-bf42-d8c93943ece7', 'cb6b5628-9fab-4654-bc86-bc72319ee9df', '7fab22ad-2933-4a2f-b7e9-2100455a62d9'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:07 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:28:07 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "cinder-87eaf391-b987-4ae4-bc38-4c4318bfb4ba-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-87eaf391-b987-4ae4-bc38-4c4318bfb4ba-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:08 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.658s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Deleted volume successfully. Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "cinder-quobyte-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-abc1e730-7307-4de0-bc0b-8c166a60656d tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-2f67a9cf-3aea-423b-a6a3-45f916a076ac-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a430aad1-e3d3-49be-8ba0-62282e0c8b63]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:08 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba Jul 09 15:28:08 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:08 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" returned: 0 in 0.757s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:08 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba Jul 09 15:28:08 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:09 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" returned: 0 in 0.648s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-quobyte-87eaf391-b987-4ae4-bc38-4c4318bfb4ba" released by "delete_volume" :: held 1.444s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:09 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Created reservations ['a4d3438f-cbe0-48d0-9209-32bb5675e4ce', '054da7ee-5bfd-49ac-a8f5-461d5f4866d8', 'd0c8b370-0cc3-4d35-a241-29e169a13132', '29cc56a6-ac56-4ae0-98ae-24a47c3ee963'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:09 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:28:09 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:10 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.661s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:10 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Deleted volume successfully. Jul 09 15:28:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ffb18a22-03ec-4781-84a0-526ab6e8dc38 tempest-SnapshotDependencyTests-1113021944 None] Lock "cinder-87eaf391-b987-4ae4-bc38-4c4318bfb4ba-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:19 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=28,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:28:20 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=19,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (24ae978c-7e1d-48a0-ad60-814238e33392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3e3b9c-9db3-48cd-b11d-49039542652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3e3b9c-9db3-48cd-b11d-49039542652c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-599370970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6965908c-f4e0-469f-9547-5cda48395d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:28Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3751855b-c24e-4a8e-9635-817c8a2e24bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3751855b-c24e-4a8e-9635-817c8a2e24bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1085c547-4bca-4f7c-bd54-19aac1926742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1085c547-4bca-4f7c-bd54-19aac1926742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6965908c-f4e0-469f-9547-5cda48395d9c', 'volume_name': 'volume-6965908c-f4e0-469f-9547-5cda48395d9c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e81bcb-59b2-4488-80d9-f96529464710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e81bcb-59b2-4488-80d9-f96529464710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0175a65-eaeb-4812-8e7c-e7667dbf17b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume 6965908c-f4e0-469f-9547-5cda48395d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6965908c-f4e0-469f-9547-5cda48395d9c', 'volume_size': 1} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-599370970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6965908c-f4e0-469f-9547-5cda48395d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:28Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Creating volume 6965908c-f4e0-469f-9547-5cda48395d9c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:28 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:28 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c 1073741824 Jul 09 15:28:28 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Flow 'volume_create_manager' (994ca19f-823f-4b59-ba0c-ee3337e4b805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8937f0e8-1ba1-43e8-ac88-97301f1beae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8937f0e8-1ba1-43e8-ac88-97301f1beae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-819602421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fd6304-e51b-4b9c-bf6c-0820916d5924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16f7f5b51004648ab5e65a1bb7ee7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:29Z,use_quota=True,user_id='53cc7c293cc342618a47fe260122abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00f336d-2c5c-409d-959e-b215c09c4a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00f336d-2c5c-409d-959e-b215c09c4a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a337f521-ad1d-41d0-bd8e-0e6eb651e206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a337f521-ad1d-41d0-bd8e-0e6eb651e206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06fd6304-e51b-4b9c-bf6c-0820916d5924', 'volume_name': 'volume-06fd6304-e51b-4b9c-bf6c-0820916d5924', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56400fd3-05a9-48ec-9896-d8e75c717a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56400fd3-05a9-48ec-9896-d8e75c717a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb89eb52-75b4-4fb6-8393-8b9f67227a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Volume 06fd6304-e51b-4b9c-bf6c-0820916d5924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06fd6304-e51b-4b9c-bf6c-0820916d5924', 'volume_size': 1} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (b11c3441-a956-4718-a199-753500e4b512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64461f0-7bfe-448a-88bc-65379cb2c160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64461f0-7bfe-448a-88bc-65379cb2c160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-51298864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1266c312-dfac-4f11-9bbe-87de13c39698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:29Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de611eb-e973-48ea-aaa8-b208990663de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de611eb-e973-48ea-aaa8-b208990663de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8bcbc1-d693-45d6-9b22-86fe863220f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8bcbc1-d693-45d6-9b22-86fe863220f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1266c312-dfac-4f11-9bbe-87de13c39698', 'volume_name': 'volume-1266c312-dfac-4f11-9bbe-87de13c39698', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3d394d-cd33-4d7c-9b19-3e19ee2a90f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3d394d-cd33-4d7c-9b19-3e19ee2a90f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede85e4d-6241-4ded-be0e-21429862f24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume 1266c312-dfac-4f11-9bbe-87de13c39698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1266c312-dfac-4f11-9bbe-87de13c39698', 'volume_size': 1} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Flow 'volume_create_manager' (c7022e9c-aab8-4fb4-83f2-233e04f2ff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6c55e9-8fb1-45b8-8e42-534ccd76d173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6c55e9-8fb1-45b8-8e42-534ccd76d173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1067201942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f59808-8e96-4aa0-8563-bb6989db8c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16f7f5b51004648ab5e65a1bb7ee7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:29Z,use_quota=True,user_id='53cc7c293cc342618a47fe260122abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015041d9-dd18-4e50-9030-49d0de6690ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015041d9-dd18-4e50-9030-49d0de6690ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb274e0f-c08d-4afa-b089-eccdda38a559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb274e0f-c08d-4afa-b089-eccdda38a559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f59808-8e96-4aa0-8563-bb6989db8c6f', 'volume_name': 'volume-32f59808-8e96-4aa0-8563-bb6989db8c6f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bedc554-cf12-4a53-aa33-c66606c75fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bedc554-cf12-4a53-aa33-c66606c75fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969a4f58-3696-4135-86f5-6b4553989cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Volume 32f59808-8e96-4aa0-8563-bb6989db8c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f59808-8e96-4aa0-8563-bb6989db8c6f', 'volume_size': 1} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:29 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c 1073741824" returned: 0 in 1.126s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Flow 'volume_create_manager' (a251eae2-8138-4038-bd47-8ff144ae3426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1def9569-7ce1-488d-8906-946a44238367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1def9569-7ce1-488d-8906-946a44238367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1287105382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd37954-6057-41b9-8dae-c742251055e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16f7f5b51004648ab5e65a1bb7ee7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:30Z,use_quota=True,user_id='53cc7c293cc342618a47fe260122abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8335e6fe-9245-4b18-ad8a-82ea5166e83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8335e6fe-9245-4b18-ad8a-82ea5166e83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5954e169-f0c0-4c8b-92fd-14dd7798af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5954e169-f0c0-4c8b-92fd-14dd7798af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd37954-6057-41b9-8dae-c742251055e5', 'volume_name': 'volume-9cd37954-6057-41b9-8dae-c742251055e5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329a2c37-bede-48ad-ad67-5a5fd6428f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329a2c37-bede-48ad-ad67-5a5fd6428f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6746b0cf-3c0b-4245-9581-0d5652a90858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:29 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Volume 9cd37954-6057-41b9-8dae-c742251055e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd37954-6057-41b9-8dae-c742251055e5', 'volume_size': 1} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:29 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c Jul 09 15:28:29 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Flow 'volume_create_manager' (bf633a22-65f4-49e9-be82-bb1a6349d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878ed0fd-6871-4ab9-8457-5ee35d370a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878ed0fd-6871-4ab9-8457-5ee35d370a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-459446239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d42338-2fdc-4319-bccf-a6feb1f08711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16f7f5b51004648ab5e65a1bb7ee7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:30Z,use_quota=True,user_id='53cc7c293cc342618a47fe260122abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5d7351-0ace-4f3e-9d79-ffe8d5841f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5d7351-0ace-4f3e-9d79-ffe8d5841f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6263dd9-a929-4ce5-a51c-bb33583576f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6263dd9-a929-4ce5-a51c-bb33583576f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d42338-2fdc-4319-bccf-a6feb1f08711', 'volume_name': 'volume-47d42338-2fdc-4319-bccf-a6feb1f08711', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7964f347-6e87-4feb-b4fb-ae14c1bb24c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7964f347-6e87-4feb-b4fb-ae14c1bb24c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61166fe-1295-4f02-a38f-7fd8d3608723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Volume 47d42338-2fdc-4319-bccf-a6feb1f08711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d42338-2fdc-4319-bccf-a6feb1f08711', 'volume_size': 1} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:30 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c" returned: 0 in 0.741s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.670s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-819602421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fd6304-e51b-4b9c-bf6c-0820916d5924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16f7f5b51004648ab5e65a1bb7ee7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:29Z,use_quota=True,user_id='53cc7c293cc342618a47fe260122abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Creating volume 06fd6304-e51b-4b9c-bf6c-0820916d5924 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:30 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924 1073741824 Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0175a65-eaeb-4812-8e7c-e7667dbf17b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6965908c-f4e0-469f-9547-5cda48395d9c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:30 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a86b8b-bd03-4028-9ecf-1980da0fb982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume volume-6965908c-f4e0-469f-9547-5cda48395d9c (6965908c-f4e0-469f-9547-5cda48395d9c): created successfully Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a86b8b-bd03-4028-9ecf-1980da0fb982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (24ae978c-7e1d-48a0-ad60-814238e33392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Flow 'volume_create_manager' (070d94b0-7b0f-47f7-aba3-9b645bd46907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daee0456-3762-45c1-80d6-0e9d59239683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9fc7c505-7897-4c85-ac6a-2edc61b5ebe3 tempest-CreateVolumesFromSnapshotTest-291368698 None] Created volume successfully. Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daee0456-3762-45c1-80d6-0e9d59239683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-793158262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94f1fe7-3339-4e56-8b4f-6ba60b97699a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16f7f5b51004648ab5e65a1bb7ee7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:31Z,use_quota=True,user_id='53cc7c293cc342618a47fe260122abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217ad414-4229-4587-ab81-99a29fff9265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217ad414-4229-4587-ab81-99a29fff9265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa912aa-e4c5-49a5-9f7e-5faba90b0495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa912aa-e4c5-49a5-9f7e-5faba90b0495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94f1fe7-3339-4e56-8b4f-6ba60b97699a', 'volume_name': 'volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b8d4e1-254e-45a6-8e38-d919b3a9ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b8d4e1-254e-45a6-8e38-d919b3a9ec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d19e1c-f89c-4a98-82fc-e97628340dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Volume b94f1fe7-3339-4e56-8b4f-6ba60b97699a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a', 'volume_size': 1} Jul 09 15:28:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:31 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924 1073741824" returned: 0 in 0.874s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:31 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924 Jul 09 15:28:31 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:32 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924" returned: 0 in 0.692s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.126s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-51298864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1266c312-dfac-4f11-9bbe-87de13c39698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:29Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Creating volume 1266c312-dfac-4f11-9bbe-87de13c39698 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:32 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb89eb52-75b4-4fb6-8393-8b9f67227a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06fd6304-e51b-4b9c-bf6c-0820916d5924', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b32e61f-78b9-4d75-904d-14cc4db4cfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:32 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698 1073741824 Jul 09 15:28:32 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Volume volume-06fd6304-e51b-4b9c-bf6c-0820916d5924 (06fd6304-e51b-4b9c-bf6c-0820916d5924): created successfully Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b32e61f-78b9-4d75-904d-14cc4db4cfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Flow 'volume_create_manager' (994ca19f-823f-4b59-ba0c-ee3337e4b805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-72bdaf50-c739-4e71-8f4d-3516cef4d0ad tempest-CreateVolumesFromImageTest-979508970 None] Created volume successfully. Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Flow 'volume_create_manager' (10b9b733-f48a-49dc-bdec-ff5aba1cae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80336a6-24ce-48af-96f8-33bb053c1048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80336a6-24ce-48af-96f8-33bb053c1048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50104da9-0217-4c30-9611-d4a08f107a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643c68465d444ce28980a70d3c8a17b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:33Z,use_quota=True,user_id='8a19aec8abb34a058cc035b007e369ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d4a6f15-d85a-49b6-97d2-22de0722fb29),volume_type_id=9d4a6f15-d85a-49b6-97d2-22de0722fb29)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1163d04e-8230-4bc9-93c5-c1f97d80bb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1163d04e-8230-4bc9-93c5-c1f97d80bb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb610ca-0763-462d-b9fa-63aed60b6cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:32 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:28:33 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698 1073741824" returned: 0 in 0.912s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb610ca-0763-462d-b9fa-63aed60b6cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50104da9-0217-4c30-9611-d4a08f107a96', 'volume_name': 'volume-50104da9-0217-4c30-9611-d4a08f107a96', 'volume_size': 1, 'image_id': '14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c2013bd5543354c5f435ce02301d34b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '643c68465d444ce28980a70d3c8a17b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ec4491f81d4bd8cf6390d303a92905ab83689a1d0979d8df6b47e970e59586924ce8bbcbb004228b7ce2b2d7d4921f4b2370ce5f47765ebeed5cd42ed514c97', 'id': '14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'created_at': datetime.datetime(2026, 7, 9, 13, 28, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 28, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14fa31ac-2bb7-4cd9-ae14-d0837366943e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225b2bb5-09c0-4dbd-873e-3476e8c623df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225b2bb5-09c0-4dbd-873e-3476e8c623df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c70b132-4740-416d-854c-e2425721e184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:33 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Volume 50104da9-0217-4c30-9611-d4a08f107a96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50104da9-0217-4c30-9611-d4a08f107a96', 'volume_size': 1, 'image_id': '14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c2013bd5543354c5f435ce02301d34b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '643c68465d444ce28980a70d3c8a17b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ec4491f81d4bd8cf6390d303a92905ab83689a1d0979d8df6b47e970e59586924ce8bbcbb004228b7ce2b2d7d4921f4b2370ce5f47765ebeed5cd42ed514c97', 'id': '14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'created_at': datetime.datetime(2026, 7, 9, 13, 28, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 28, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14fa31ac-2bb7-4cd9-ae14-d0837366943e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Trying to clone 50104da9-0217-4c30-9611-d4a08f107a96 from image 14fa31ac-2bb7-4cd9-ae14-d0837366943e at location (None, [{'url': 'file:///opt/stack/data/glance/images/14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:33 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698 Jul 09 15:28:33 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:28:33 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Image download 0.00 MB at 0.00 MB/s Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee0366f-6f9b-4322-8eff-b7905cc22d45]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:33 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD Jul 09 15:28:33 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:33 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698" returned: 0 in 0.648s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.405s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1067201942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f59808-8e96-4aa0-8563-bb6989db8c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16f7f5b51004648ab5e65a1bb7ee7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:29Z,use_quota=True,user_id='53cc7c293cc342618a47fe260122abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Creating volume 32f59808-8e96-4aa0-8563-bb6989db8c6f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:33 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:33 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f 1073741824 Jul 09 15:28:33 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:33 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede85e4d-6241-4ded-be0e-21429862f24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1266c312-dfac-4f11-9bbe-87de13c39698', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449b3f25-bac7-4eec-be7e-c7bac696d296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume volume-1266c312-dfac-4f11-9bbe-87de13c39698 (1266c312-dfac-4f11-9bbe-87de13c39698): created successfully Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449b3f25-bac7-4eec-be7e-c7bac696d296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (b11c3441-a956-4718-a199-753500e4b512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:34 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2a8b8de6-6dac-4911-9833-eae1abf3f903 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created volume successfully. Jul 09 15:28:34 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:34 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD Jul 09 15:28:34 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (6a3c4c72-cca6-42ee-b90b-6569cd5075ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:34 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0e218c-de73-4cd1-936c-f1b25a209196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f 1073741824" returned: 0 in 0.927s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0e218c-de73-4cd1-936c-f1b25a209196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-600323600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f87467-d8bb-4690-bb1f-ac66b3f9da57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:35Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166d619e-5e73-49ae-b5b9-37a719bf5046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166d619e-5e73-49ae-b5b9-37a719bf5046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376ea3bf-cf89-4e2c-b960-c1ccf3209d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376ea3bf-cf89-4e2c-b960-c1ccf3209d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f87467-d8bb-4690-bb1f-ac66b3f9da57', 'volume_name': 'volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c21418-d44a-46f5-bb98-7dbffbbe2438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c21418-d44a-46f5-bb98-7dbffbbe2438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b679ca91-2e2d-47e8-b242-c38de31a8fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:34 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume 56f87467-d8bb-4690-bb1f-ac66b3f9da57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57', 'volume_size': 1} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:35 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f Jul 09 15:28:35 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:35 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD" returned: 1 in 0.853s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Temporary image 14fa31ac-2bb7-4cd9-ae14-d0837366943e is fetched for user 8a19aec8abb34a058cc035b007e369ee. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[73347951-ddf1-4e5e-8a62-18e737a88801]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:35 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD Jul 09 15:28:35 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (28973f68-3d87-48df-a5b8-a27525c549a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07fe16d-b197-4fe1-a7d6-4c998d9b4388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07fe16d-b197-4fe1-a7d6-4c998d9b4388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-754487319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:35Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f4f944-588a-494e-a7a4-0d44349bb7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f4f944-588a-494e-a7a4-0d44349bb7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1463760a-3fe6-4610-9d73-21519bc30421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1463760a-3fe6-4610-9d73-21519bc30421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f', 'volume_name': 'volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ed4307-80e2-45cd-b731-6c40d8712e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ed4307-80e2-45cd-b731-6c40d8712e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16a400b-96b8-421d-8c1d-6d209f46f060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume 17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f', 'volume_size': 1} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:35 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f" returned: 0 in 0.766s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.808s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1287105382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd37954-6057-41b9-8dae-c742251055e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16f7f5b51004648ab5e65a1bb7ee7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:30Z,use_quota=True,user_id='53cc7c293cc342618a47fe260122abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Creating volume 9cd37954-6057-41b9-8dae-c742251055e5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:35 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969a4f58-3696-4135-86f5-6b4553989cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f59808-8e96-4aa0-8563-bb6989db8c6f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:35 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5 1073741824 Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572efba8-68fd-4f5a-9297-3744af6e0248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (893412e4-a756-4300-8563-a41c50c65a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bce7c28-dcb4-4bb0-9249-34d4ee315d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bce7c28-dcb4-4bb0-9249-34d4ee315d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-836692509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287a16a0-8a1b-4792-b068-c57d71296e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:36Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99c304f-1e26-4c26-b959-f2c02f56bb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99c304f-1e26-4c26-b959-f2c02f56bb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b458b66-1a59-4a49-95e3-3f32b909d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b458b66-1a59-4a49-95e3-3f32b909d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287a16a0-8a1b-4792-b068-c57d71296e7c', 'volume_name': 'volume-287a16a0-8a1b-4792-b068-c57d71296e7c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e2427c-0698-4db9-af9f-2c5bd3f0d589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e2427c-0698-4db9-af9f-2c5bd3f0d589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d8395b-0c65-445f-9489-32a67b19f1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume 287a16a0-8a1b-4792-b068-c57d71296e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287a16a0-8a1b-4792-b068-c57d71296e7c', 'volume_size': 1} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Volume volume-32f59808-8e96-4aa0-8563-bb6989db8c6f (32f59808-8e96-4aa0-8563-bb6989db8c6f): created successfully Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572efba8-68fd-4f5a-9297-3744af6e0248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Flow 'volume_create_manager' (c7022e9c-aab8-4fb4-83f2-233e04f2ff3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-6c1b894c-e626-49e3-9c32-1d1c67a50497 tempest-CreateVolumesFromImageTest-979508970 None] Created volume successfully. Jul 09 15:28:36 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD" returned: 0 in 1.005s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:36 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD Jul 09 15:28:36 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (cbfed682-9331-400e-9f24-7f82cbc1d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cfb8d3-d565-41a5-87e3-308fedcb893f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cfb8d3-d565-41a5-87e3-308fedcb893f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-626117814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38043f31-4ad2-4358-b3b8-ee91391ab69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:36Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800c9427-875a-40da-ac7e-90b12bc12929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800c9427-875a-40da-ac7e-90b12bc12929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989c3e70-4f01-47ed-9bb2-dd14040a096d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989c3e70-4f01-47ed-9bb2-dd14040a096d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38043f31-4ad2-4358-b3b8-ee91391ab69a', 'volume_name': 'volume-38043f31-4ad2-4358-b3b8-ee91391ab69a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065105ff-f5e9-4367-9130-f953fb5af4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065105ff-f5e9-4367-9130-f953fb5af4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e22135-bacb-4ea3-a3b9-b5d935b2639d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume 38043f31-4ad2-4358-b3b8-ee91391ab69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38043f31-4ad2-4358-b3b8-ee91391ab69a', 'volume_size': 1} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (5a504650-0a1f-42f2-9a53-0132761ff6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3912205-511f-4d6c-973a-0203c83f47d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3912205-511f-4d6c-973a-0203c83f47d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-333073692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ca921a-e961-4cc6-85e1-6ea90bbf9f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:37Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be4e4df-6b28-4b5c-b1a8-035baf871cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be4e4df-6b28-4b5c-b1a8-035baf871cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91842cb8-35d2-46ff-9071-4446ed51839d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91842cb8-35d2-46ff-9071-4446ed51839d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ca921a-e961-4cc6-85e1-6ea90bbf9f11', 'volume_name': 'volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e505f83-0f2a-438b-bdd2-999885b59cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e505f83-0f2a-438b-bdd2-999885b59cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47057f6-e0cb-47e5-ab7c-bf291e6f1ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:36 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume 21ca921a-e961-4cc6-85e1-6ea90bbf9f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11', 'volume_size': 1} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:36 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5 1073741824" returned: 0 in 1.066s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:36 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5 Jul 09 15:28:36 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:36 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD" returned: 1 in 0.827s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:28:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:37 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5" returned: 0 in 0.634s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.073s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-459446239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d42338-2fdc-4319-bccf-a6feb1f08711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16f7f5b51004648ab5e65a1bb7ee7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:30Z,use_quota=True,user_id='53cc7c293cc342618a47fe260122abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Creating volume 47d42338-2fdc-4319-bccf-a6feb1f08711 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:37 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:37 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711 1073741824 Jul 09 15:28:37 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6746b0cf-3c0b-4245-9581-0d5652a90858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd37954-6057-41b9-8dae-c742251055e5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb0c2dc-d489-4116-91ac-bea7622cc1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Volume volume-9cd37954-6057-41b9-8dae-c742251055e5 (9cd37954-6057-41b9-8dae-c742251055e5): created successfully Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb0c2dc-d489-4116-91ac-bea7622cc1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Flow 'volume_create_manager' (a251eae2-8138-4038-bd47-8ff144ae3426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9cd5fb93-86cf-435c-b0dd-ed097709d119 tempest-CreateVolumesFromImageTest-979508970 None] Created volume successfully. Jul 09 15:28:38 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711 1073741824" returned: 0 in 0.851s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:38 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711 Jul 09 15:28:38 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:39 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711" returned: 0 in 0.663s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.156s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-793158262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94f1fe7-3339-4e56-8b4f-6ba60b97699a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16f7f5b51004648ab5e65a1bb7ee7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:31Z,use_quota=True,user_id='53cc7c293cc342618a47fe260122abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Creating volume b94f1fe7-3339-4e56-8b4f-6ba60b97699a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:39 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:39 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a 1073741824 Jul 09 15:28:39 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61166fe-1295-4f02-a38f-7fd8d3608723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d42338-2fdc-4319-bccf-a6feb1f08711', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ff73c4-ee10-46de-83d1-b59dc0ced7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Volume volume-47d42338-2fdc-4319-bccf-a6feb1f08711 (47d42338-2fdc-4319-bccf-a6feb1f08711): created successfully Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ff73c4-ee10-46de-83d1-b59dc0ced7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Flow 'volume_create_manager' (bf633a22-65f4-49e9-be82-bb1a6349d20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c4e1b795-3494-49c3-88c8-d3158a65806b tempest-CreateVolumesFromImageTest-979508970 None] Created volume successfully. Jul 09 15:28:39 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a 1073741824" returned: 0 in 0.827s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:39 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a Jul 09 15:28:39 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:40 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a" returned: 0 in 0.634s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.472s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d19e1c-f89c-4a98-82fc-e97628340dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e73ff1-04e9-49a9-a47c-5602c9db898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Creating offline snapshot 194659c4-53ea-4b60-af5a-b3d40c8a9913 of volume 6965908c-f4e0-469f-9547-5cda48395d9c {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:28:40 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Volume volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a (b94f1fe7-3339-4e56-8b4f-6ba60b97699a): created successfully Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e73ff1-04e9-49a9-a47c-5602c9db898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Flow 'volume_create_manager' (070d94b0-7b0f-47f7-aba3-9b645bd46907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd591c6c-245a-441a-a52a-ada3958c3826]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3c7224c2-ca5a-449e-a946-447261e38ca1 tempest-CreateVolumesFromImageTest-979508970 None] Created volume successfully. Jul 09 15:28:40 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c Jul 09 15:28:40 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:41 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c" returned: 0 in 0.764s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:41 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 1G Jul 09 15:28:41 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "cinder-b94f1fe7-3339-4e56-8b4f-6ba60b97699a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-b94f1fe7-3339-4e56-8b4f-6ba60b97699a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "cinder-quobyte-b94f1fe7-3339-4e56-8b4f-6ba60b97699a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-quobyte-b94f1fe7-3339-4e56-8b4f-6ba60b97699a" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d2df0a-31a2-42fb-8ab8-cd73cb10d647]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:41 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a Jul 09 15:28:41 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:42 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 1G" returned: 0 in 0.778s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6965908c-f4e0-469f-9547-5cda48395d9c -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:42 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6965908c-f4e0-469f-9547-5cda48395d9c -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 Jul 09 15:28:42 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:42 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a" returned: 0 in 0.771s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:42 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a Jul 09 15:28:42 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:42 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6965908c-f4e0-469f-9547-5cda48395d9c -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913" returned: 0 in 0.683s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:42 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 is being set with open permissions: ugo+rw Jul 09 15:28:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:42 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 Jul 09 15:28:42 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:43 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-b94f1fe7-3339-4e56-8b4f-6ba60b97699a" returned: 0 in 0.648s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-quobyte-b94f1fe7-3339-4e56-8b4f-6ba60b97699a" released by "delete_volume" :: held 1.472s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Created reservations ['d2953116-3dd1-4e98-88be-6b9fafaa0085', '99aebed4-ee17-4094-928a-789486ba7922', '0afeb45a-2ae6-4840-90ae-dc2829084652', '3806cb35-4554-4846-b2db-69b2c56bfee4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:43 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:28:43 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:43 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913" returned: 0 in 0.651s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:43 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.info Jul 09 15:28:43 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "cinder-47d42338-2fdc-4319-bccf-a6feb1f08711-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-47d42338-2fdc-4319-bccf-a6feb1f08711-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "cinder-quobyte-47d42338-2fdc-4319-bccf-a6feb1f08711" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-quobyte-47d42338-2fdc-4319-bccf-a6feb1f08711" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:44 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.717s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Deleted volume successfully. Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dac8af2-ee5d-4c4b-93a6-ecc8a8aa61fa]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9cdbd43e-2ac0-4dd6-93ad-59b9ff5fbd85 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-b94f1fe7-3339-4e56-8b4f-6ba60b97699a-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:44 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711 Jul 09 15:28:44 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:44 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.info" returned: 0 in 0.720s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:44 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.info is being set with open permissions: ugo+rw Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:44 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.info Jul 09 15:28:44 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:44 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711" returned: 0 in 0.763s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:44 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711 Jul 09 15:28:44 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:44 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.info" returned: 0 in 0.650s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.365s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.979s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-600323600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f87467-d8bb-4690-bb1f-ac66b3f9da57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:35Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Creating volume 56f87467-d8bb-4690-bb1f-ac66b3f9da57 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:44 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:44 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57 1073741824 Jul 09 15:28:44 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-691b4771-dbe9-42e5-9c01-39a617e3a3fe tempest-CreateVolumesFromSnapshotTest-291368698 None] Create snapshot completed successfully Jul 09 15:28:45 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-47d42338-2fdc-4319-bccf-a6feb1f08711" returned: 0 in 0.656s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-quobyte-47d42338-2fdc-4319-bccf-a6feb1f08711" released by "delete_volume" :: held 1.481s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Created reservations ['455ae45d-f67d-4589-a0ad-a8e37ab4b4a9', 'c004b4c8-c53c-4ae5-8068-85a2c30aeb74', '9b6edc38-7a47-4541-8c19-49840258817d', '7e6e8688-53e3-41fa-968d-9a4ad2bcfa7a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:45 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:28:45 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:45 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57 1073741824" returned: 0 in 0.937s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:45 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57 Jul 09 15:28:45 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (90edc3b8-1a2f-49f2-8fd2-9f991657784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1badbab1-de25-442d-865d-88875b9cbfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "cinder-9cd37954-6057-41b9-8dae-c742251055e5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1badbab1-de25-442d-865d-88875b9cbfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1636454756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be75614-1a0d-462c-b641-a5ab3598e59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:46Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251ea969-1dd0-45a0-80cf-634eb47eaa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251ea969-1dd0-45a0-80cf-634eb47eaa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c979668-4bcd-478e-b7f8-c833b3107850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c979668-4bcd-478e-b7f8-c833b3107850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be75614-1a0d-462c-b641-a5ab3598e59b', 'volume_name': 'volume-3be75614-1a0d-462c-b641-a5ab3598e59b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23d4988-dace-4e4f-bc3a-793491901de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23d4988-dace-4e4f-bc3a-793491901de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb54af3-f1af-4120-8cc3-83a85bdfd645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume 3be75614-1a0d-462c-b641-a5ab3598e59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be75614-1a0d-462c-b641-a5ab3598e59b', 'volume_size': 1} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-9cd37954-6057-41b9-8dae-c742251055e5-delete_volume" acquired by "delete_volume" :: waited 0.170s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:46 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.791s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Deleted volume successfully. Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "cinder-quobyte-9cd37954-6057-41b9-8dae-c742251055e5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-quobyte-9cd37954-6057-41b9-8dae-c742251055e5" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9575ce3c-5e43-4bb3-aa5a-8297567cb3e2 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-47d42338-2fdc-4319-bccf-a6feb1f08711-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f309dbb1-8699-4ec2-8e2f-035cf3d09bb2]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:46 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5 Jul 09 15:28:46 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (52cbdd3a-5fbc-4ddb-8c82-330cd2527d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e09d9a-211d-41f8-9e07-5850a7974614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e09d9a-211d-41f8-9e07-5850a7974614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1811194751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e140cc23-9ff8-4b7a-b8e8-025f69c5e69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:47Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84288e9d-402f-419c-af35-202682bd3896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84288e9d-402f-419c-af35-202682bd3896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28dd41cd-dac7-47f5-acc6-cde0f675fd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28dd41cd-dac7-47f5-acc6-cde0f675fd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e140cc23-9ff8-4b7a-b8e8-025f69c5e69a', 'volume_name': 'volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1e6b84-0d76-4cfd-b9bc-69629c3d6a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1e6b84-0d76-4cfd-b9bc-69629c3d6a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf01f63-adfe-40ae-bc87-ba9be9739b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume e140cc23-9ff8-4b7a-b8e8-025f69c5e69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a', 'volume_size': 1} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:46 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57" returned: 0 in 0.897s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.399s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-754487319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:35Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Creating volume 17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:46 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:46 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f 1073741824 Jul 09 15:28:46 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b679ca91-2e2d-47e8-b242-c38de31a8fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2cd4cf-b5a2-4ffe-9306-fcac76648461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57 (56f87467-d8bb-4690-bb1f-ac66b3f9da57): created successfully Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2cd4cf-b5a2-4ffe-9306-fcac76648461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (6a3c4c72-cca6-42ee-b90b-6569cd5075ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1e01f17b-8c68-4235-84e0-b849db98cc82 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created volume successfully. Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (bbea6058-3334-4e20-91ae-b4f2d2ddc463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bc0ff2-57ea-4f79-a518-0b39308f775b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bc0ff2-57ea-4f79-a518-0b39308f775b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-135592933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4fd6e4-4459-48fb-a667-1644b876eb4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:47Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396ed413-3bd5-4338-adbf-c7a89786a87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396ed413-3bd5-4338-adbf-c7a89786a87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e8dbca-a342-4c3d-b5ea-35d5194a4618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e8dbca-a342-4c3d-b5ea-35d5194a4618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4fd6e4-4459-48fb-a667-1644b876eb4e', 'volume_name': 'volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8df258d-f435-4d25-bcaf-c57ec7920113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8df258d-f435-4d25-bcaf-c57ec7920113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5934a9e4-2a54-46cd-9d30-a380812b47ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume ba4fd6e4-4459-48fb-a667-1644b876eb4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e', 'volume_size': 1} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (84450449-6ea5-44ba-871f-2394dfee642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac7ea75-eb19-4479-bffb-311598fc8171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac7ea75-eb19-4479-bffb-311598fc8171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2018944167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186bb495-1e03-4238-8063-a1c51bb976ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:47Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe51f391-cf27-4425-92c0-22c4a05f1196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe51f391-cf27-4425-92c0-22c4a05f1196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84224dd6-3da7-48d6-a2d9-419d09c344f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84224dd6-3da7-48d6-a2d9-419d09c344f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186bb495-1e03-4238-8063-a1c51bb976ca', 'volume_name': 'volume-186bb495-1e03-4238-8063-a1c51bb976ca', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9b64e3-a847-48b4-ad84-a129f53db44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9b64e3-a847-48b4-ad84-a129f53db44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d96a48-0cea-4bfb-8b6f-64dfa2a927b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:47 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume 186bb495-1e03-4238-8063-a1c51bb976ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186bb495-1e03-4238-8063-a1c51bb976ca', 'volume_size': 1} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:47 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5" returned: 0 in 1.125s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:47 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5 Jul 09 15:28:47 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:47 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:28:47 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:47 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f 1073741824" returned: 0 in 1.112s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:47 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (02a51ae3-2b8c-4747-92e7-0db6505d8deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c0bd2e-3532-4200-ae7d-72ec28bfb343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c0bd2e-3532-4200-ae7d-72ec28bfb343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1406553175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f31053d-522e-46b0-9136-5e55ed8e7aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:48Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:48 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f Jul 09 15:28:48 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1a134f-5e62-46fc-80ea-b5be0a1d9c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1a134f-5e62-46fc-80ea-b5be0a1d9c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108bfbc9-10f6-4723-9194-52d4772d01db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108bfbc9-10f6-4723-9194-52d4772d01db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f31053d-522e-46b0-9136-5e55ed8e7aa7', 'volume_name': 'volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2154f612-755a-4b23-a69e-100497e445cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2154f612-755a-4b23-a69e-100497e445cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c1c867-e203-4670-947d-be7929d8da60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume 1f31053d-522e-46b0-9136-5e55ed8e7aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7', 'volume_size': 1} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:48 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9cd37954-6057-41b9-8dae-c742251055e5" returned: 0 in 0.740s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-quobyte-9cd37954-6057-41b9-8dae-c742251055e5" released by "delete_volume" :: held 1.920s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Created reservations ['0693d465-72d8-48a2-acc2-2a7b6c0b5838', 'd6eb1aa0-1db1-4e00-836a-fa4cbc9ca288', '42af2333-5c9a-4138-addc-6228867bce3c', '3ae38aee-f691-49d0-8dcb-2c6264b35081'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:48 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.697s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:48 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:28:48 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "cinder-32f59808-8e96-4aa0-8563-bb6989db8c6f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-32f59808-8e96-4aa0-8563-bb6989db8c6f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:48 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f" returned: 0 in 0.688s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.785s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-836692509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287a16a0-8a1b-4792-b068-c57d71296e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:36Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Creating volume 287a16a0-8a1b-4792-b068-c57d71296e7c {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:48 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:48 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c 1073741824 Jul 09 15:28:48 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "cinder-quobyte-32f59808-8e96-4aa0-8563-bb6989db8c6f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16a400b-96b8-421d-8c1d-6d209f46f060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c19474d-3bc9-4080-b9f6-f39bd220cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f (17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f): created successfully Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c19474d-3bc9-4080-b9f6-f39bd220cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (28973f68-3d87-48df-a5b8-a27525c549a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-quobyte-32f59808-8e96-4aa0-8563-bb6989db8c6f" acquired by "delete_volume" :: waited 0.051s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-dae580da-1603-4543-a107-b5fb45874e53 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created volume successfully. Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28a31c-3705-405a-94c7-ecc6903f0acd]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:48 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f Jul 09 15:28:48 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:49 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.715s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:49 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Deleted volume successfully. Jul 09 15:28:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d976e3f5-b0f3-4af8-be2c-6ef33f349c13 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-9cd37954-6057-41b9-8dae-c742251055e5-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:49 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c 1073741824" returned: 0 in 0.883s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:49 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f" returned: 0 in 0.818s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:49 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c Jul 09 15:28:49 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:49 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f Jul 09 15:28:49 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:50 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c" returned: 0 in 0.672s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.917s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:50 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-626117814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38043f31-4ad2-4358-b3b8-ee91391ab69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:36Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Creating volume 38043f31-4ad2-4358-b3b8-ee91391ab69a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:50 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-32f59808-8e96-4aa0-8563-bb6989db8c6f" returned: 0 in 0.685s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:50 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a 1073741824 Jul 09 15:28:50 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-quobyte-32f59808-8e96-4aa0-8563-bb6989db8c6f" released by "delete_volume" :: held 1.561s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d8395b-0c65-445f-9489-32a67b19f1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287a16a0-8a1b-4792-b068-c57d71296e7c', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d8da70-ab6d-468a-9675-ee995dac1809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume volume-287a16a0-8a1b-4792-b068-c57d71296e7c (287a16a0-8a1b-4792-b068-c57d71296e7c): created successfully Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d8da70-ab6d-468a-9675-ee995dac1809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (893412e4-a756-4300-8563-a41c50c65a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d9304358-7cd4-4214-9f72-e69bae6c776f tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created volume successfully. Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Created reservations ['4ce8b845-888f-4430-849a-e6335d5f56cb', '884e9a00-6a6c-47b5-9e4a-e970041454cd', '7102dcaf-2c83-47d3-b8bf-29dba000fff3', 'ae3ea3dc-bbb6-4495-be65-56c0e184abe2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:50 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:28:50 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "cinder-06fd6304-e51b-4b9c-bf6c-0820916d5924-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-06fd6304-e51b-4b9c-bf6c-0820916d5924-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "cinder-quobyte-06fd6304-e51b-4b9c-bf6c-0820916d5924" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-quobyte-06fd6304-e51b-4b9c-bf6c-0820916d5924" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b706508-5201-4f0f-b196-b36bcde49957]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:51 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924 Jul 09 15:28:51 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:51 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.697s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:51 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Deleted volume successfully. Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-336d3faf-31a7-4ef5-be42-05aaff158841 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-32f59808-8e96-4aa0-8563-bb6989db8c6f-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:51 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a 1073741824" returned: 0 in 0.929s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:51 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a Jul 09 15:28:51 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:51 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924" returned: 0 in 0.817s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:51 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924 Jul 09 15:28:51 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:51 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a" returned: 0 in 0.671s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.206s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-333073692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ca921a-e961-4cc6-85e1-6ea90bbf9f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eae9d7e554c4a9207686ac681607d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:37Z,use_quota=True,user_id='4f1952dc54874c2388f8f11adc14c315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Creating volume 21ca921a-e961-4cc6-85e1-6ea90bbf9f11 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:51 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e22135-bacb-4ea3-a3b9-b5d935b2639d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38043f31-4ad2-4358-b3b8-ee91391ab69a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:52 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11 1073741824 Jul 09 15:28:52 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4da06b7-48f5-49ed-8f5b-d9585c020e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:52 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume volume-38043f31-4ad2-4358-b3b8-ee91391ab69a (38043f31-4ad2-4358-b3b8-ee91391ab69a): created successfully Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4da06b7-48f5-49ed-8f5b-d9585c020e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (cbfed682-9331-400e-9f24-7f82cbc1d67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ed7711d9-67d7-40c6-9da7-d845893f809c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created volume successfully. Jul 09 15:28:52 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-06fd6304-e51b-4b9c-bf6c-0820916d5924" returned: 0 in 0.650s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-quobyte-06fd6304-e51b-4b9c-bf6c-0820916d5924" released by "delete_volume" :: held 1.516s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Created reservations ['88fd3612-cd4d-4f30-8a3d-fc7209daacf7', '2136bc68-fa3c-48d7-a88d-ebb295ca77f5', 'ca24c28a-4bf0-45c0-9978-e121ae5a962c', 'd44c1c2f-9c5d-4315-8fe4-70f446751629'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:52 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:28:52 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:52 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11 1073741824" returned: 0 in 0.886s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:52 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11 Jul 09 15:28:52 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:53 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.736s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Deleted volume successfully. Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bff8ab32-ef76-43dd-a35e-c14225121310 tempest-CreateVolumesFromImageTest-979508970 None] Lock "cinder-06fd6304-e51b-4b9c-bf6c-0820916d5924-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:53 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11" returned: 0 in 0.661s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.646s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50104da9-0217-4c30-9611-d4a08f107a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643c68465d444ce28980a70d3c8a17b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:33Z,use_quota=True,user_id='8a19aec8abb34a058cc035b007e369ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d4a6f15-d85a-49b6-97d2-22de0722fb29),volume_type_id=9d4a6f15-d85a-49b6-97d2-22de0722fb29)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Creating volume 50104da9-0217-4c30-9611-d4a08f107a96 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47057f6-e0cb-47e5-ab7c-bf291e6f1ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:53 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 1073741824 Jul 09 15:28:53 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec1027c-a05e-4914-b551-bea1cd1cfd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Volume volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11 (21ca921a-e961-4cc6-85e1-6ea90bbf9f11): created successfully Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec1027c-a05e-4914-b551-bea1cd1cfd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Flow 'volume_create_manager' (5a504650-0a1f-42f2-9a53-0132761ff6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:53 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5a095529-c795-4688-9bf2-6acbf20f732c tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created volume successfully. Jul 09 15:28:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-21ca921a-e961-4cc6-85e1-6ea90bbf9f11-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-21ca921a-e961-4cc6-85e1-6ea90bbf9f11-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-quobyte-21ca921a-e961-4cc6-85e1-6ea90bbf9f11" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-21ca921a-e961-4cc6-85e1-6ea90bbf9f11" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9870ad2b-a9df-471a-819c-2590e2ac8d7c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:54 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11 Jul 09 15:28:54 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:54 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 1073741824" returned: 0 in 0.978s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:54 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 Jul 09 15:28:54 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:55 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11" returned: 0 in 0.846s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:55 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11 Jul 09 15:28:55 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:55 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96" returned: 0 in 0.676s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.938s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1636454756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be75614-1a0d-462c-b641-a5ab3598e59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:46Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Creating volume 3be75614-1a0d-462c-b641-a5ab3598e59b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:55 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:55 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b 1073741824 Jul 09 15:28:55 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Attempting download of 14fa31ac-2bb7-4cd9-ae14-d0837366943e ((None, [{'url': 'file:///opt/stack/data/glance/images/14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'metadata': {}}])) to volume 50104da9-0217-4c30-9611-d4a08f107a96. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f30a31-d880-4caa-b764-fbd4263454e8]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14fa31ac-2bb7-4cd9-ae14-d0837366943e_1c3ww_0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:55 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14fa31ac-2bb7-4cd9-ae14-d0837366943e_1c3ww_0d Jul 09 15:28:55 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:55 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-21ca921a-e961-4cc6-85e1-6ea90bbf9f11" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-21ca921a-e961-4cc6-85e1-6ea90bbf9f11" released by "delete_volume" :: held 1.651s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created reservations ['11ef2296-7a89-4e13-8df0-43c01d9b81a2', '879486d7-5d2a-40dc-8835-5ff68c639434', 'efc550cd-c86a-47d7-a64c-81d5715ab28b', '01235876-b452-4614-984c-6e402a924baf'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:56 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:28:56 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:56 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14fa31ac-2bb7-4cd9-ae14-d0837366943e_1c3ww_0d" returned: 0 in 0.837s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14fa31ac-2bb7-4cd9-ae14-d0837366943e_1c3ww_0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Flow 'volume_create_manager' (b0294417-bc91-446e-950a-06780171327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:56 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffda7e1-a069-4fd2-96ab-2a220af60ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b 1073741824" returned: 0 in 1.066s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffda7e1-a069-4fd2-96ab-2a220af60ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-306708667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d901728d-3173-4c6e-b849-f110f02a9efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd310d36371748919f707ccad41d1fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:56Z,use_quota=True,user_id='049e175e650a4074a0a2f7825b981a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bafe4b-6a0d-44fa-ac93-4bea8d443bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bafe4b-6a0d-44fa-ac93-4bea8d443bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:56 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14fa31ac-2bb7-4cd9-ae14-d0837366943e_1c3ww_0d Jul 09 15:28:56 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c86e17-cd1f-45a8-8eb8-8f5edd2eca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c86e17-cd1f-45a8-8eb8-8f5edd2eca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd901728d-3173-4c6e-b849-f110f02a9efc', 'volume_name': 'volume-d901728d-3173-4c6e-b849-f110f02a9efc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ed42bb-2769-4b53-9469-f2cf84d61ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ed42bb-2769-4b53-9469-f2cf84d61ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53571add-cdec-491e-8221-f860b6e1fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Volume d901728d-3173-4c6e-b849-f110f02a9efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d901728d-3173-4c6e-b849-f110f02a9efc', 'volume_size': 1} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-38043f31-4ad2-4358-b3b8-ee91391ab69a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-38043f31-4ad2-4358-b3b8-ee91391ab69a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:56 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b Jul 09 15:28:56 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-quobyte-38043f31-4ad2-4358-b3b8-ee91391ab69a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-38043f31-4ad2-4358-b3b8-ee91391ab69a" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[345330b2-288c-4747-9e1c-1b72619499fe]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:56 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a Jul 09 15:28:56 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:56 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.877s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Deleted volume successfully. Jul 09 15:28:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d40326d5-242c-43e4-8039-69693e4edaa6 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-21ca921a-e961-4cc6-85e1-6ea90bbf9f11-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:57 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14fa31ac-2bb7-4cd9-ae14-d0837366943e_1c3ww_0d" returned: 1 in 0.905s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14fa31ac-2bb7-4cd9-ae14-d0837366943e_1c3ww_0d' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a509b4-af0a-446e-ac30-2f1542361e33]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:57 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b" returned: 0 in 0.727s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.538s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1811194751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e140cc23-9ff8-4b7a-b8e8-025f69c5e69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:47Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Creating volume e140cc23-9ff8-4b7a-b8e8-025f69c5e69a {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb54af3-f1af-4120-8cc3-83a85bdfd645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be75614-1a0d-462c-b641-a5ab3598e59b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3b854d-7b44-44e7-a96b-e35e6fdeb93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:57 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a 1073741824 Jul 09 15:28:57 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:57 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD Jul 09 15:28:57 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume volume-3be75614-1a0d-462c-b641-a5ab3598e59b (3be75614-1a0d-462c-b641-a5ab3598e59b): created successfully Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3b854d-7b44-44e7-a96b-e35e6fdeb93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (90edc3b8-1a2f-49f2-8fd2-9f991657784e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a655f11d-3149-4faf-bbfb-5bdd730a37ad tempest-CreateVolumesFromSnapshotTest-291368698 None] Created volume successfully. Jul 09 15:28:57 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a" returned: 0 in 0.873s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:57 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a Jul 09 15:28:57 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:58 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:58 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD Jul 09 15:28:58 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:58 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a 1073741824" returned: 0 in 0.913s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:58 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-38043f31-4ad2-4358-b3b8-ee91391ab69a" returned: 0 in 0.711s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-38043f31-4ad2-4358-b3b8-ee91391ab69a" released by "delete_volume" :: held 1.637s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:58 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a Jul 09 15:28:58 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created reservations ['e3fa6240-a5c1-403c-8239-961093bf08a9', '57fe036e-57fd-4f88-9003-614991cafac2', '61744a25-851f-49fe-9f41-a2be6390ec06', '6c91c75e-e4d2-4718-a4c0-bd9137775ef1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:58 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:28:58 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-287a16a0-8a1b-4792-b068-c57d71296e7c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-287a16a0-8a1b-4792-b068-c57d71296e7c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:58 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD" returned: 1 in 0.797s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] 14fa31ac-2bb7-4cd9-ae14-d0837366943e was raw, converting to raw {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-quobyte-287a16a0-8a1b-4792-b068-c57d71296e7c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:28:58 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 Jul 09 15:28:58 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-287a16a0-8a1b-4792-b068-c57d71296e7c" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[feffadf4-1adb-4868-b97f-7e198c2a44ca]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:28:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:59 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a" returned: 0 in 0.744s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.814s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-135592933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4fd6e4-4459-48fb-a667-1644b876eb4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:47Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Creating volume ba4fd6e4-4459-48fb-a667-1644b876eb4e {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:28:59 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:59 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c Jul 09 15:28:59 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:59 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e 1073741824 Jul 09 15:28:59 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf01f63-adfe-40ae-bc87-ba9be9739b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58935d9c-f687-4ee2-b285-b6803a09893f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:28:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a (e140cc23-9ff8-4b7a-b8e8-025f69c5e69a): created successfully Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58935d9c-f687-4ee2-b285-b6803a09893f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (52cbdd3a-5fbc-4ddb-8c82-330cd2527d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:28:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-62cd581b-8d42-4f4b-8bbf-83c88446ecab tempest-CreateVolumesFromSnapshotTest-291368698 None] Created volume successfully. Jul 09 15:28:59 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.860s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:28:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Deleted volume successfully. Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9a23e21a-02fd-4fed-ae16-9a64c1592ea8 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-38043f31-4ad2-4358-b3b8-ee91391ab69a-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:28:59 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96" returned: 0 in 0.803s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14fa31ac-2bb7-4cd9-ae14-d0837366943e_mvnk4tbudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:28:59 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:59 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 1G Jul 09 15:28:59 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:28:59 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c" returned: 0 in 0.852s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:28:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:28:59 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c Jul 09 15:28:59 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:00 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e 1073741824" returned: 0 in 0.960s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:00 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e Jul 09 15:29:00 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:00 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 1G" returned: 0 in 0.803s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83300b9-fa76-40d9-81b8-9a5d22538740]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:00 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-287a16a0-8a1b-4792-b068-c57d71296e7c" returned: 0 in 0.804s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:00 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 Jul 09 15:29:00 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-287a16a0-8a1b-4792-b068-c57d71296e7c" released by "delete_volume" :: held 1.712s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created reservations ['a6812361-25e7-4c83-b512-dad74e752d77', '79c6ed15-497e-4969-9e4d-5f3992dd3b0c', '1b9e8b2d-3dc9-496e-a5f5-9f74bdbac944', 'd32b2a38-eb91-437c-b829-ea64d140f085'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:00 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:00 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:00 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e" returned: 0 in 0.762s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.198s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2018944167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186bb495-1e03-4238-8063-a1c51bb976ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:47Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Creating volume 186bb495-1e03-4238-8063-a1c51bb976ca {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:00 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:00 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca 1073741824 Jul 09 15:29:00 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5934a9e4-2a54-46cd-9d30-a380812b47ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d253e1c0-e8a4-4923-92f9-20d680d64d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:00 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e (ba4fd6e4-4459-48fb-a667-1644b876eb4e): created successfully Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d253e1c0-e8a4-4923-92f9-20d680d64d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:00 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (bbea6058-3334-4e20-91ae-b4f2d2ddc463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-31cde5ce-61e9-4b64-8ecd-e9f9f6c9949e tempest-CreateVolumesFromSnapshotTest-291368698 None] Created volume successfully. Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-quobyte-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d6d8f-eb49-478e-8548-dba7521f3903]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:01 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f Jul 09 15:29:01 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:01 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96" returned: 0 in 0.930s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:01 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 Jul 09 15:29:01 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:01 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.850s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:01 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Deleted volume successfully. Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b59d93ee-d1bf-4463-9797-5459e51d7152 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-287a16a0-8a1b-4792-b068-c57d71296e7c-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:01 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca 1073741824" returned: 0 in 1.056s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:01 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca Jul 09 15:29:01 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:02 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f" returned: 0 in 0.920s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:02 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f Jul 09 15:29:02 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:02 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96" returned: 1 in 0.870s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Downloaded image 14fa31ac-2bb7-4cd9-ae14-d0837366943e ((None, [{'url': 'file:///opt/stack/data/glance/images/14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'metadata': {}}])) to volume 50104da9-0217-4c30-9611-d4a08f107a96 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Temporary image 14fa31ac-2bb7-4cd9-ae14-d0837366943e for user 8a19aec8abb34a058cc035b007e369ee is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Marking volume 50104da9-0217-4c30-9611-d4a08f107a96 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Copying metadata from image 14fa31ac-2bb7-4cd9-ae14-d0837366943e to 50104da9-0217-4c30-9611-d4a08f107a96. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Creating volume glance metadata for volume 50104da9-0217-4c30-9611-d4a08f107a96 backed by image 14fa31ac-2bb7-4cd9-ae14-d0837366943e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1c2013bd5543354c5f435ce02301d34b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c70b132-4740-416d-854c-e2425721e184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50104da9-0217-4c30-9611-d4a08f107a96', 'volume_size': 1, 'image_id': '14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c2013bd5543354c5f435ce02301d34b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '643c68465d444ce28980a70d3c8a17b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ec4491f81d4bd8cf6390d303a92905ab83689a1d0979d8df6b47e970e59586924ce8bbcbb004228b7ce2b2d7d4921f4b2370ce5f47765ebeed5cd42ed514c97', 'id': '14fa31ac-2bb7-4cd9-ae14-d0837366943e', 'created_at': datetime.datetime(2026, 7, 9, 13, 28, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 28, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14fa31ac-2bb7-4cd9-ae14-d0837366943e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae0442b-04fc-4ef1-9752-19eceadbd962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Volume volume-50104da9-0217-4c30-9611-d4a08f107a96 (50104da9-0217-4c30-9611-d4a08f107a96): created successfully Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae0442b-04fc-4ef1-9752-19eceadbd962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Flow 'volume_create_manager' (10b9b733-f48a-49dc-bdec-ff5aba1cae1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cb2d4b1f-0054-4894-9678-827a0c1561df tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Created volume successfully. Jul 09 15:29:02 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca" returned: 0 in 0.721s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.555s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1406553175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f31053d-522e-46b0-9136-5e55ed8e7aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cf5aad92e84a839b1467d9132530cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:48Z,use_quota=True,user_id='9415241a51ee448b951b7b3661e6f0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Creating volume 1f31053d-522e-46b0-9136-5e55ed8e7aa7 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:02 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d96a48-0cea-4bfb-8b6f-64dfa2a927b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186bb495-1e03-4238-8063-a1c51bb976ca', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:02 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7 1073741824 Jul 09 15:29:02 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50c55c8-8914-4acb-b205-1b8817fc9b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:02 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume volume-186bb495-1e03-4238-8063-a1c51bb976ca (186bb495-1e03-4238-8063-a1c51bb976ca): created successfully Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50c55c8-8914-4acb-b205-1b8817fc9b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (84450449-6ea5-44ba-871f-2394dfee642b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-07fe7257-693a-4f1b-83d3-5981b422e78f tempest-CreateVolumesFromSnapshotTest-291368698 None] Created volume successfully. Jul 09 15:29:02 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f" returned: 0 in 0.671s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f" released by "delete_volume" :: held 1.697s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created reservations ['22a21a7b-85b1-43a7-adcd-edbd9ed69132', '71e29877-0599-41be-a6ab-5309f0101731', '3a7e0383-80c4-4b01-9e56-2becfa446e5b', '0181d3f7-23be-4851-af58-b60077b7e9f2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Acquiring lock "cinder-50104da9-0217-4c30-9611-d4a08f107a96-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Lock "cinder-50104da9-0217-4c30-9611-d4a08f107a96-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:03 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:03 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Acquiring lock "cinder-quobyte-50104da9-0217-4c30-9611-d4a08f107a96" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Lock "cinder-quobyte-50104da9-0217-4c30-9611-d4a08f107a96" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea063ce1-a512-42a6-86bc-972c211b7db2]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:03 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 Jul 09 15:29:03 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-56f87467-d8bb-4690-bb1f-ac66b3f9da57-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-56f87467-d8bb-4690-bb1f-ac66b3f9da57-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-quobyte-56f87467-d8bb-4690-bb1f-ac66b3f9da57" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-56f87467-d8bb-4690-bb1f-ac66b3f9da57" acquired by "delete_volume" :: waited 0.032s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd87296e-df87-4cd1-af74-ad5b3a083018]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:03 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57 Jul 09 15:29:03 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:03 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7 1073741824" returned: 0 in 1.010s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:03 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7 Jul 09 15:29:03 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:03 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.827s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Deleted volume successfully. Jul 09 15:29:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b0ab8095-1a70-44c7-8099-5e00d32c3019 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-17bfeeef-e8ee-4860-b0f0-b4eb1eb12d9f-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:04 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96" returned: 0 in 0.946s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:04 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 Jul 09 15:29:04 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:04 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57" returned: 0 in 0.894s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:04 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57 Jul 09 15:29:04 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:04 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7" returned: 0 in 0.765s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-306708667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d901728d-3173-4c6e-b849-f110f02a9efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd310d36371748919f707ccad41d1fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:28:56Z,use_quota=True,user_id='049e175e650a4074a0a2f7825b981a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Creating volume d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:04 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:04 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc 1073741824 Jul 09 15:29:04 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c1c867-e203-4670-947d-be7929d8da60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754c49e3-f93c-4647-9cf4-75358436f252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:04 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Volume volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7 (1f31053d-522e-46b0-9136-5e55ed8e7aa7): created successfully Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754c49e3-f93c-4647-9cf4-75358436f252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Flow 'volume_create_manager' (02a51ae3-2b8c-4747-92e7-0db6505d8deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:04 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9098ed74-95d9-43c3-a63a-def0fb4474d2 tempest-CreateVolumesFromSnapshotTest-291368698 None] Created volume successfully. Jul 09 15:29:04 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96" returned: 1 in 0.839s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:29:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:04 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96 Jul 09 15:29:04 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:05 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-56f87467-d8bb-4690-bb1f-ac66b3f9da57" returned: 0 in 0.719s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-56f87467-d8bb-4690-bb1f-ac66b3f9da57" released by "delete_volume" :: held 1.667s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created reservations ['7fa84dd3-cb8a-452b-8454-8cd4c3fb33c9', '8ca1dd3e-3974-4382-a589-5af591fa82c1', '0ec0846e-4224-41ad-9562-b0b2edbd0ef0', '8fcd0d04-70b2-410e-9971-4d90140a5268'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:05 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:05 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-1f31053d-522e-46b0-9136-5e55ed8e7aa7-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:05 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc 1073741824" returned: 0 in 1.017s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-1f31053d-522e-46b0-9136-5e55ed8e7aa7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:05 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc Jul 09 15:29:05 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-quobyte-1f31053d-522e-46b0-9136-5e55ed8e7aa7" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-1f31053d-522e-46b0-9136-5e55ed8e7aa7" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-1266c312-dfac-4f11-9bbe-87de13c39698-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef208d3f-ce4d-4fc0-938f-b2febf4c8a5e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-1266c312-dfac-4f11-9bbe-87de13c39698-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:05 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-50104da9-0217-4c30-9611-d4a08f107a96" returned: 0 in 0.887s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Lock "cinder-quobyte-50104da9-0217-4c30-9611-d4a08f107a96" released by "delete_volume" :: held 2.754s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "cinder-quobyte-1266c312-dfac-4f11-9bbe-87de13c39698" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:05 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7 Jul 09 15:29:05 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-1266c312-dfac-4f11-9bbe-87de13c39698" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd77e68-d15d-42e0-abc7-cc2eb66271e1]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Created reservations ['ead4d390-894f-49ca-935c-55bfc714d886', '29532e4b-4739-4ad0-a5f0-af31990117ec', '3280d5df-c0f2-4b9a-a5f4-8b495fc466c7', '991bcd5f-fcce-4a45-8d3a-01b78e7c40b1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:06 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698 Jul 09 15:29:06 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:06 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:06 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:06 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.006s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Deleted volume successfully. Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b226c788-acb5-4cf1-aa87-7b091631bfe9 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-56f87467-d8bb-4690-bb1f-ac66b3f9da57-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:06 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc" returned: 0 in 1.089s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.194s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53571add-cdec-491e-8221-f860b6e1fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d901728d-3173-4c6e-b849-f110f02a9efc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28428238-7921-4f6e-8e79-edb5e59e1fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Volume volume-d901728d-3173-4c6e-b849-f110f02a9efc (d901728d-3173-4c6e-b849-f110f02a9efc): created successfully Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28428238-7921-4f6e-8e79-edb5e59e1fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Flow 'volume_create_manager' (b0294417-bc91-446e-950a-06780171327f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:06 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-87c97e58-b9f1-4f3a-8aad-540c7ff51833 tempest-VolumeDependencyTests-489292252 None] Created volume successfully. Jul 09 15:29:06 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7" returned: 0 in 1.146s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:06 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7 Jul 09 15:29:06 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:07 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698" returned: 0 in 1.066s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:07 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698 Jul 09 15:29:07 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:07 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.139s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Deleted volume successfully. Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e49765c9-63d4-4d7e-ad07-b925d1b108ee tempest-VolumeAndVolumeTypeFromImageTest-1231746934 None] Lock "cinder-50104da9-0217-4c30-9611-d4a08f107a96-delete_volume" released by "delete_volume" :: held 4.297s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Creating offline snapshot cfa42b10-b80a-43a5-acab-ad8772f9c62c of volume d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae425542-69cf-4b13-8b64-a8e691be8643]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:07 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc Jul 09 15:29:07 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:07 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1f31053d-522e-46b0-9136-5e55ed8e7aa7" returned: 0 in 0.903s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-1f31053d-522e-46b0-9136-5e55ed8e7aa7" released by "delete_volume" :: held 2.138s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:07 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266c312-dfac-4f11-9bbe-87de13c39698" returned: 0 in 0.841s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-quobyte-1266c312-dfac-4f11-9bbe-87de13c39698" released by "delete_volume" :: held 1.972s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Created reservations ['f95e8c84-e34f-4d36-8b03-591cc6092202', 'cb7dbb00-1f81-4cfc-bfc0-47144295fff6', 'cbc44bcf-aebf-4efa-b4d6-da6dc8889a5c', 'e4063763-4ded-47f8-8f54-c518682a5e61'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:07 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Created reservations ['98b51230-046a-4ba7-b050-001b9b5f8969', '9fd32236-74b5-48c1-a8a6-acacfbd532d2', '3f2b671d-5d3a-431b-a4eb-ee82d8bd6079', '235c7aff-d00f-462a-b773-026175b5a303'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:08 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:08 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:08 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:08 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:08 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc" returned: 0 in 0.989s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:08 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c 1G Jul 09 15:29:08 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-186bb495-1e03-4238-8063-a1c51bb976ca-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:08 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.867s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:08 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:08 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Deleted volume successfully. Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-186bb495-1e03-4238-8063-a1c51bb976ca-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:09 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.869s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0adea3df-5235-4971-956d-37299c9ce9d7 tempest-CreateVolumesFromSourceVolumeTest-350539851 None] Lock "cinder-1266c312-dfac-4f11-9bbe-87de13c39698-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Deleted volume successfully. Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-quobyte-186bb495-1e03-4238-8063-a1c51bb976ca" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ed19cf47-0716-43e1-b321-824a811092d1 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-1f31053d-522e-46b0-9136-5e55ed8e7aa7-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-186bb495-1e03-4238-8063-a1c51bb976ca" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[195426d8-cb68-4c4b-968c-5aa0ba57bda0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:09 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca Jul 09 15:29:09 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:09 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c 1G" returned: 0 in 1.238s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d901728d-3173-4c6e-b849-f110f02a9efc -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:09 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d901728d-3173-4c6e-b849-f110f02a9efc -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c Jul 09 15:29:09 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:10 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca" returned: 0 in 0.918s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:10 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca Jul 09 15:29:10 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:10 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d901728d-3173-4c6e-b849-f110f02a9efc -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c" returned: 0 in 0.931s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:10 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c is being set with open permissions: ugo+rw Jul 09 15:29:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:10 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c Jul 09 15:29:10 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:10 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-186bb495-1e03-4238-8063-a1c51bb976ca" returned: 0 in 0.855s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:10 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-186bb495-1e03-4238-8063-a1c51bb976ca" released by "delete_volume" :: held 1.827s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:10 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Created reservations ['884dfd30-06a5-4187-b1c1-9af8e6a9c5a2', '77e0ceb8-db4c-436c-add5-9f8191bf64f9', '9aba65d3-b8a6-4d63-8701-6dd1f985ba94', 'b66cda6f-53ad-4f8a-9042-f9b4dea512ae'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:11 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:11 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-ba4fd6e4-4459-48fb-a667-1644b876eb4e-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-ba4fd6e4-4459-48fb-a667-1644b876eb4e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-quobyte-ba4fd6e4-4459-48fb-a667-1644b876eb4e" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-ba4fd6e4-4459-48fb-a667-1644b876eb4e" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8288c95-04be-4d4b-8b7d-1ff4fef1b030]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:11 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c" returned: 0 in 0.889s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:11 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.info Jul 09 15:29:11 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:11 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e Jul 09 15:29:11 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:11 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.870s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:11 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Deleted volume successfully. Jul 09 15:29:12 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1443e351-a4f0-43ca-9827-d3c53bf85598 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-186bb495-1e03-4238-8063-a1c51bb976ca-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:12 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.info" returned: 0 in 0.800s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:12 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.info is being set with open permissions: ugo+rw Jul 09 15:29:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:12 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.info Jul 09 15:29:12 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:12 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e" returned: 0 in 1.047s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:12 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e Jul 09 15:29:12 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:13 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.info" returned: 0 in 0.808s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.818s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:13 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-76f08516-3ea9-427c-8bfb-ad59c99b88da tempest-VolumeDependencyTests-489292252 None] Create snapshot completed successfully Jul 09 15:29:13 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ba4fd6e4-4459-48fb-a667-1644b876eb4e" returned: 0 in 0.779s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-ba4fd6e4-4459-48fb-a667-1644b876eb4e" released by "delete_volume" :: held 1.878s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Created reservations ['7bc0709a-3954-4487-9a7e-93e00a854e7a', 'bb66d8cd-00d8-450e-9d04-2e76b97a3076', 'e3a6da2d-ba22-41db-b2e7-cfc86029843e', 'f29dd51a-6bce-4ab9-8183-cde670fed5cb'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:13 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:13 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Flow 'volume_create_manager' (c3c1e459-12d2-459e-be86-24e70ed32b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4deb9fd-8b33-4790-8998-0283aef3a177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4deb9fd-8b33-4790-8998-0283aef3a177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549186290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715293d5-e79e-4eb0-83ef-e411551202e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69032801b4e9458092d9e76cf3d2bdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:14Z,use_quota=True,user_id='3a2e5df1bbc1412abc7e3d9eab402d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f08a78b-e396-48d6-a53b-aeac316e8427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f08a78b-e396-48d6-a53b-aeac316e8427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c40696-0cb5-4733-a1f0-b88709f3fbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c40696-0cb5-4733-a1f0-b88709f3fbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '715293d5-e79e-4eb0-83ef-e411551202e7', 'volume_name': 'volume-715293d5-e79e-4eb0-83ef-e411551202e7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ff5da8-542a-456e-8ca4-ba28c94b61de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ff5da8-542a-456e-8ca4-ba28c94b61de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05557f4-b469-4291-9fb0-d4599e34adc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:13 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Volume 715293d5-e79e-4eb0-83ef-e411551202e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-715293d5-e79e-4eb0-83ef-e411551202e7', 'volume_size': 1} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549186290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715293d5-e79e-4eb0-83ef-e411551202e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69032801b4e9458092d9e76cf3d2bdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:14Z,use_quota=True,user_id='3a2e5df1bbc1412abc7e3d9eab402d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Creating volume 715293d5-e79e-4eb0-83ef-e411551202e7 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:13 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:13 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7 1073741824 Jul 09 15:29:13 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-quobyte-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a" acquired by "delete_volume" :: waited 0.036s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[10584b8f-c038-43be-8735-5629f5e18101]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:14 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a Jul 09 15:29:14 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:14 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.872s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Deleted volume successfully. Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b3b1a9d1-cfb7-44e2-be80-2eb3c75f4fea tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-ba4fd6e4-4459-48fb-a667-1644b876eb4e-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Flow 'volume_create_manager' (9d15afc8-f5a8-46d8-8d97-c2e0395eff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711d359f-9d34-4575-bc62-90d3c529d65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711d359f-9d34-4575-bc62-90d3c529d65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1345643743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fa2c53-5bfb-4a51-8016-52a66e1cb330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd310d36371748919f707ccad41d1fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cfa42b10-b80a-43a5-acab-ad8772f9c62c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:15Z,use_quota=True,user_id='049e175e650a4074a0a2f7825b981a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a63e66-ec96-48ea-bd3d-75d7c142cd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a63e66-ec96-48ea-bd3d-75d7c142cd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70abce8e-0bdb-4e01-884e-2bdb7dc55ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70abce8e-0bdb-4e01-884e-2bdb7dc55ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16fa2c53-5bfb-4a51-8016-52a66e1cb330', 'volume_name': 'volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330', 'volume_size': 1, 'snapshot_id': 'cfa42b10-b80a-43a5-acab-ad8772f9c62c'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbcaedb2-854e-4a3c-9b04-ce4337cbbfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbcaedb2-854e-4a3c-9b04-ce4337cbbfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fc307c-538f-44f7-a4a3-96b08fea959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:14 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Volume 16fa2c53-5bfb-4a51-8016-52a66e1cb330: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330', 'volume_size': 1, 'snapshot_id': 'cfa42b10-b80a-43a5-acab-ad8772f9c62c'} Jul 09 15:29:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:15 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a" returned: 0 in 1.107s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:15 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7 1073741824" returned: 0 in 1.282s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:15 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a Jul 09 15:29:15 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:15 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7 Jul 09 15:29:15 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Flow 'volume_create_manager' (0c6346ec-b06a-49af-88f1-e89aede0c65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704450eb-2f17-4aa2-abc7-3f77dd639feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704450eb-2f17-4aa2-abc7-3f77dd639feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fd42b38e7d4b39917b11caa52d8eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:15Z,use_quota=True,user_id='2ff50feace5c429c8af9b6323b06ac32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea286f8a-694f-4871-a377-0eff80992e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea286f8a-694f-4871-a377-0eff80992e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa2ad77-0673-4442-8351-29d4ab5896b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.image.glance [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Creating Keystone auth plugin from conf {{(pid=86916) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa2ad77-0673-4442-8351-29d4ab5896b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517', 'volume_name': 'volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517', 'volume_size': 1, 'image_id': '9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02e95a3ff7c0948ffbe7ef51eb605371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '62fd42b38e7d4b39917b11caa52d8eb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4169576ddf5e337a57bbc7ce525611ebb41f90341ed11379c9049d163cf312c1939b2200d304d4301801454f5f3b6a1b1f1c9d82d329e61a17e8909ba4651cc8', 'id': '9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'created_at': datetime.datetime(2026, 7, 9, 13, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 29, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a4abbed-e35d-4fc9-8ac7-38dab7004c2c/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd00f84-c13a-449b-b070-a4e75d43c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd00f84-c13a-449b-b070-a4e75d43c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8352c9c-aeb6-4815-894a-c3d28cae23b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Volume 9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517', 'volume_size': 1, 'image_id': '9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02e95a3ff7c0948ffbe7ef51eb605371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '62fd42b38e7d4b39917b11caa52d8eb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4169576ddf5e337a57bbc7ce525611ebb41f90341ed11379c9049d163cf312c1939b2200d304d4301801454f5f3b6a1b1f1c9d82d329e61a17e8909ba4651cc8', 'id': '9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'created_at': datetime.datetime(2026, 7, 9, 13, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 29, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a4abbed-e35d-4fc9-8ac7-38dab7004c2c/file', 'properties': {}}, 'image_service': } Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Trying to clone 9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 from image 9a4abbed-e35d-4fc9-8ac7-38dab7004c2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'metadata': {}}]). {{(pid=86916) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 15:29:15 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a" returned: 0 in 0.695s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a" released by "delete_volume" :: held 1.872s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 15:29:15 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Image download 0.00 MB at 0.00 MB/s Jul 09 15:29:15 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7" returned: 0 in 0.718s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.096s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Acquiring lock "cinder-quobyte-cfa42b10-b80a-43a5-acab-ad8772f9c62c-16fa2c53-5bfb-4a51-8016-52a66e1cb330" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Created reservations ['31b5e24f-1011-4ec5-bf97-6def30a79273', '8244f18f-976b-4918-900c-97c8de248618', '81f8a9cf-c1db-46ca-9baf-9002f8f06c37', '590608f7-6a9b-44bb-9c84-c59c0f3c241d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05557f4-b469-4291-9fb0-d4599e34adc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-715293d5-e79e-4eb0-83ef-e411551202e7', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829df945-4709-4968-879d-a9098eae5349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b6902a-446e-4738-9195-3b2fe5da38df]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-cfa42b10-b80a-43a5-acab-ad8772f9c62c-16fa2c53-5bfb-4a51-8016-52a66e1cb330" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Creating volume 16fa2c53-5bfb-4a51-8016-52a66e1cb330 from snapshot cfa42b10-b80a-43a5-acab-ad8772f9c62c {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Acquiring lock "cinder-quobyte-16fa2c53-5bfb-4a51-8016-52a66e1cb330" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Volume volume-715293d5-e79e-4eb0-83ef-e411551202e7 (715293d5-e79e-4eb0-83ef-e411551202e7): created successfully Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829df945-4709-4968-879d-a9098eae5349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Flow 'volume_create_manager' (c3c1e459-12d2-459e-be86-24e70ed32b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-16fa2c53-5bfb-4a51-8016-52a66e1cb330" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] snapshot: cfa42b10-b80a-43a5-acab-ad8772f9c62c, volume: 16fa2c53-5bfb-4a51-8016-52a66e1cb330, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:29:15 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1452ae20-1750-433c-b4c0-74db80a316fb tempest-ProjectReaderTests-308318388 None] Created volume successfully. Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5113c62-b3ab-405c-9710-88ddf39539f4]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:16 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD Jul 09 15:29:16 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:16 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:16 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:16 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c Jul 09 15:29:16 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:16 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:16 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.709s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Deleted volume successfully. Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de295c1d-a8ce-4d32-b16f-8708778829ae tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-e140cc23-9ff8-4b7a-b8e8-025f69c5e69a-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:16 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD Jul 09 15:29:16 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:16 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c" returned: 0 in 0.816s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d901728d-3173-4c6e-b849-f110f02a9efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e19c44-1d18-41f9-824d-33bf25f9134b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-3be75614-1a0d-462c-b641-a5ab3598e59b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-3be75614-1a0d-462c-b641-a5ab3598e59b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:17 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc Jul 09 15:29:17 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Acquiring lock "cinder-715293d5-e79e-4eb0-83ef-e411551202e7-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Lock "cinder-715293d5-e79e-4eb0-83ef-e411551202e7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-quobyte-3be75614-1a0d-462c-b641-a5ab3598e59b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-3be75614-1a0d-462c-b641-a5ab3598e59b" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Acquiring lock "cinder-quobyte-715293d5-e79e-4eb0-83ef-e411551202e7" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fa7a69-19a2-42d1-b627-9e989d0a3c60]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Lock "cinder-quobyte-715293d5-e79e-4eb0-83ef-e411551202e7" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf52d3d-4d39-4e4a-b9ed-39f49cfa9982]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:17 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b Jul 09 15:29:17 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:17 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7 Jul 09 15:29:17 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:17 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD" returned: 1 in 0.894s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Temporary image 9a4abbed-e35d-4fc9-8ac7-38dab7004c2c is fetched for user 2ff50feace5c429c8af9b6323b06ac32. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c875927a-216f-4746-9dab-9a2218ad2a56]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:17 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc" returned: 0 in 0.914s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:29:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:17 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD Jul 09 15:29:17 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:17 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 Jul 09 15:29:17 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:18 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7" returned: 0 in 0.820s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:18 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b" returned: 0 in 0.884s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:18 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7 Jul 09 15:29:18 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:18 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b Jul 09 15:29:18 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:18 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:18 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD Jul 09 15:29:18 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:18 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3be75614-1a0d-462c-b641-a5ab3598e59b" returned: 0 in 0.920s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-3be75614-1a0d-462c-b641-a5ab3598e59b" released by "delete_volume" :: held 1.881s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:19 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-715293d5-e79e-4eb0-83ef-e411551202e7" returned: 0 in 0.996s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Lock "cinder-quobyte-715293d5-e79e-4eb0-83ef-e411551202e7" released by "delete_volume" :: held 1.890s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Created reservations ['293bdd42-3e9c-485c-958d-d0baaf057a40', '2ad4f602-8215-4e82-8a84-604d3a43018c', 'e7d0cbac-ee45-443c-9ba1-01acf3261b26', '7def25ea-edf0-4444-a4e2-e732bafa472f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Created reservations ['e0e72b7a-c369-463e-b705-508c77ed209d', 'ffbdfadb-fd7a-4393-8336-22852536bb9e', '1e28ab9d-aa4c-44e2-a75a-d6c3cb602e99', 'a57d088e-5b53-4a25-a2e0-81b976f29e12'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:19 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:19 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:19 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:19 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:20 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD" returned: 1 in 1.546s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-194659c4-53ea-4b60-af5a-b3d40c8a9913-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-194659c4-53ea-4b60-af5a-b3d40c8a9913-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-quobyte-6965908c-f4e0-469f-9547-5cda48395d9c" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-6965908c-f4e0-469f-9547-5cda48395d9c" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-quobyte-194659c4-53ea-4b60-af5a-b3d40c8a9913" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-194659c4-53ea-4b60-af5a-b3d40c8a9913" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Deleting offline snapshot 194659c4-53ea-4b60-af5a-b3d40c8a9913 of volume 6965908c-f4e0-469f-9547-5cda48395d9c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] snapshot_file for this snap is: volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5f82bb-a720-46f1-b84f-dda695ba5d35]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:21 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.903s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:21 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 Jul 09 15:29:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Deleted volume successfully. Jul 09 15:29:21 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:21 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=200,cinder:SELECT=153,cinder:DELETE=22,cinder:INSERT=49 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:29:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e9bbfcfb-348e-4eb0-817c-dafa32ecccb4 tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-3be75614-1a0d-462c-b641-a5ab3598e59b-delete_volume" released by "delete_volume" :: held 4.454s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:21 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 2.037s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:21 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Deleted volume successfully. Jul 09 15:29:21 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=142,cinder:UPDATE=220,cinder:INSERT=56,cinder:DELETE=18 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:29:21 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f6df4-c6b2-464d-b7f9-523b8298ad94 tempest-ProjectReaderTests-308318388 None] Lock "cinder-715293d5-e79e-4eb0-83ef-e411551202e7-delete_volume" released by "delete_volume" :: held 4.707s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Flow 'volume_create_manager' (10003d4b-7d70-4d63-83b6-ecb09f2934fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d15d38f-df87-49aa-8269-c21093277843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d15d38f-df87-49aa-8269-c21093277843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-270331858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d445fa13-4986-4efd-aae6-7b526d49f8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69032801b4e9458092d9e76cf3d2bdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:22Z,use_quota=True,user_id='3a2e5df1bbc1412abc7e3d9eab402d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704174ba-9672-4815-8dc5-50db9750a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704174ba-9672-4815-8dc5-50db9750a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb737738-52ea-4363-a56d-82dd1bfe2085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb737738-52ea-4363-a56d-82dd1bfe2085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd445fa13-4986-4efd-aae6-7b526d49f8cc', 'volume_name': 'volume-d445fa13-4986-4efd-aae6-7b526d49f8cc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b89779f-e0d6-4f31-840e-302f38d4a161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b89779f-e0d6-4f31-840e-302f38d4a161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f959defa-550c-4119-89ff-49ed43163dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:22 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Volume d445fa13-4986-4efd-aae6-7b526d49f8cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d445fa13-4986-4efd-aae6-7b526d49f8cc', 'volume_size': 1} Jul 09 15:29:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:23 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913" returned: 0 in 2.085s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6965908c-f4e0-469f-9547-5cda48395d9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:29:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb55ad-f0f7-4126-b4e2-9b14039afd2a]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:23 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c Jul 09 15:29:23 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:23 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330" returned: 0 in 5.902s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b54f32-291b-467f-8ec0-32ee28db1a48]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:23 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc Jul 09 15:29:23 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:24 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c" returned: 0 in 0.937s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:24 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 Jul 09 15:29:24 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:24 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc" returned: 0 in 0.936s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:24 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:29:24 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Converted 1024.00 MB image at 173.45 MB/s Jul 09 15:29:24 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 is being set with open permissions: ugo+rw Jul 09 15:29:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:24 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 Jul 09 15:29:24 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:24 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913" returned: 0 in 0.736s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:24 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913 Jul 09 15:29:24 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:25 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330" returned: 0 in 0.637s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-16fa2c53-5bfb-4a51-8016-52a66e1cb330" released by "_copy_volume_from_snapshot" :: held 9.324s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-cfa42b10-b80a-43a5-acab-ad8772f9c62c-16fa2c53-5bfb-4a51-8016-52a66e1cb330" released by "_create_volume_from_snapshot" :: held 9.388s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.428s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.262s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fd42b38e7d4b39917b11caa52d8eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:15Z,use_quota=True,user_id='2ff50feace5c429c8af9b6323b06ac32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Creating volume 9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:25 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:25 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 1073741824 Jul 09 15:29:25 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fc307c-538f-44f7-a4a3-96b08fea959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330', 'volume_size': 1, 'snapshot_id': 'cfa42b10-b80a-43a5-acab-ad8772f9c62c'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85168f4-f0e2-445b-8bcc-15b5c2c06647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:25 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Volume volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 (16fa2c53-5bfb-4a51-8016-52a66e1cb330): created successfully Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85168f4-f0e2-445b-8bcc-15b5c2c06647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Flow 'volume_create_manager' (9d15afc8-f5a8-46d8-8d97-c2e0395eff57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:25 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c.194659c4-53ea-4b60-af5a-b3d40c8a9913" returned: 0 in 0.653s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-1d24d9d3-6975-4380-b594-ff3418e7858d tempest-VolumeDependencyTests-489292252 None] Created volume successfully. Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-194659c4-53ea-4b60-af5a-b3d40c8a9913" released by "_delete_snapshot" :: held 4.691s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-6965908c-f4e0-469f-9547-5cda48395d9c" released by "delete_snapshot" :: held 4.745s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Created reservations ['3411f963-f040-4429-b13e-92e34581e014', '9579e5c4-b09d-4946-a733-fc6a169108f5', '5dea2ea3-360d-4f34-b5a2-44defb79f02c', '84ffc6aa-899e-4110-85ec-8356dcd4f7b4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Delete snapshot completed successfully. Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c54bb93b-735f-4e60-9fb4-3f31c994fc7a tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-194659c4-53ea-4b60-af5a-b3d40c8a9913-delete_snapshot" released by "delete_snapshot" :: held 4.903s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Acquiring lock "cinder-cfa42b10-b80a-43a5-acab-ad8772f9c62c-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Lock "cinder-cfa42b10-b80a-43a5-acab-ad8772f9c62c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Acquiring lock "cinder-quobyte-d901728d-3173-4c6e-b849-f110f02a9efc" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-d901728d-3173-4c6e-b849-f110f02a9efc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Acquiring lock "cinder-quobyte-cfa42b10-b80a-43a5-acab-ad8772f9c62c" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-cfa42b10-b80a-43a5-acab-ad8772f9c62c" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Deleting offline snapshot cfa42b10-b80a-43a5-acab-ad8772f9c62c of volume d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] snapshot_file for this snap is: volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f8bd75-1c63-4ddd-9ba9-4b8ba29a5d07]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-6965908c-f4e0-469f-9547-5cda48395d9c-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-6965908c-f4e0-469f-9547-5cda48395d9c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:26 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c Jul 09 15:29:26 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "cinder-quobyte-6965908c-f4e0-469f-9547-5cda48395d9c" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-6965908c-f4e0-469f-9547-5cda48395d9c" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c743369d-45f4-488d-bd43-babf4b8b5647]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:26 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 1073741824" returned: 0 in 0.922s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:26 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c Jul 09 15:29:26 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:26 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 Jul 09 15:29:26 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:26 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c" returned: 0 in 0.832s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d901728d-3173-4c6e-b849-f110f02a9efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[51661d0b-c23d-451c-96c4-803cceffaf5e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:26 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc Jul 09 15:29:26 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:26 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c" returned: 0 in 0.837s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:27 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517" returned: 0 in 0.724s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.723s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-270331858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d445fa13-4986-4efd-aae6-7b526d49f8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69032801b4e9458092d9e76cf3d2bdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:22Z,use_quota=True,user_id='3a2e5df1bbc1412abc7e3d9eab402d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Creating volume d445fa13-4986-4efd-aae6-7b526d49f8cc {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:27 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c Jul 09 15:29:27 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:27 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:27 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc 1073741824 Jul 09 15:29:27 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Attempting download of 9a4abbed-e35d-4fc9-8ac7-38dab7004c2c ((None, [{'url': 'file:///opt/stack/data/glance/images/9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'metadata': {}}])) to volume 9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[929a4523-7eb4-48af-84c3-16f28c7d437a]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_09kfm6hx {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:27 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_09kfm6hx Jul 09 15:29:27 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:27 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc" returned: 0 in 0.835s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:27 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c Jul 09 15:29:27 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:27 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6965908c-f4e0-469f-9547-5cda48395d9c" returned: 0 in 0.762s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-quobyte-6965908c-f4e0-469f-9547-5cda48395d9c" released by "delete_volume" :: held 1.657s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Created reservations ['0900d987-9dc3-429f-b0c8-c890904aa2db', 'e43700d2-8eb0-4183-a0e2-274f3e310576', 'f3a291c6-b96b-4fc0-9eb9-600d19ebd36c', 'efd5ef8b-3726-4802-960b-415ed7ecdf7c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:27 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:27 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:28 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc 1073741824" returned: 0 in 0.973s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:28 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_09kfm6hx" returned: 0 in 0.906s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_09kfm6hx {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:28 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc Jul 09 15:29:28 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:28 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_09kfm6hx Jul 09 15:29:28 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:28 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c" returned: 0 in 1.034s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:28 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c Jul 09 15:29:28 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:28 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.745s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Deleted volume successfully. Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3f36708b-6fd5-4a20-ba56-7aa83b00028f tempest-CreateVolumesFromSnapshotTest-291368698 None] Lock "cinder-6965908c-f4e0-469f-9547-5cda48395d9c-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:28 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc" returned: 0 in 0.802s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f959defa-550c-4119-89ff-49ed43163dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d445fa13-4986-4efd-aae6-7b526d49f8cc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc11f02-a48c-47d6-916f-4d65af82c55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Volume volume-d445fa13-4986-4efd-aae6-7b526d49f8cc (d445fa13-4986-4efd-aae6-7b526d49f8cc): created successfully Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc11f02-a48c-47d6-916f-4d65af82c55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Flow 'volume_create_manager' (10003d4b-7d70-4d63-83b6-ecb09f2934fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d834510f-7cc0-492d-8669-0d922443e6b9 tempest-ProjectReaderTests-308318388 None] Created volume successfully. Jul 09 15:29:28 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_09kfm6hx" returned: 1 in 0.915s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_09kfm6hx' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6781b0-ef8d-45b0-bebf-db20e760fd2b]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:29 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD Jul 09 15:29:29 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:29 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc.cfa42b10-b80a-43a5-acab-ad8772f9c62c" returned: 0 in 0.760s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-cfa42b10-b80a-43a5-acab-ad8772f9c62c" released by "_delete_snapshot" :: held 3.578s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-d901728d-3173-4c6e-b849-f110f02a9efc" released by "delete_snapshot" :: held 3.660s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Created reservations ['f05436db-e9c7-4e90-9368-882e37da3f68', '4f2c77e7-2452-454a-9cef-72d206f45636', '3ddd7db5-4cfb-4e57-88cd-9e7f1c9fa944', '97dbe6a4-3272-481b-9abc-ff0e4d4070a6'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Delete snapshot completed successfully. Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f69a54da-6516-43cd-9f80-a403b6a35bc0 tempest-VolumeDependencyTests-489292252 None] Lock "cinder-cfa42b10-b80a-43a5-acab-ad8772f9c62c-delete_snapshot" released by "delete_snapshot" :: held 3.864s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Acquiring lock "cinder-d445fa13-4986-4efd-aae6-7b526d49f8cc-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Lock "cinder-d445fa13-4986-4efd-aae6-7b526d49f8cc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Acquiring lock "cinder-quobyte-d445fa13-4986-4efd-aae6-7b526d49f8cc" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:29 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Lock "cinder-quobyte-d445fa13-4986-4efd-aae6-7b526d49f8cc" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f517066b-8702-46fe-a13f-acbbb863074e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:29 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD Jul 09 15:29:29 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:30 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc Jul 09 15:29:30 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Acquiring lock "cinder-d901728d-3173-4c6e-b849-f110f02a9efc-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Lock "cinder-d901728d-3173-4c6e-b849-f110f02a9efc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Acquiring lock "cinder-quobyte-d901728d-3173-4c6e-b849-f110f02a9efc" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-d901728d-3173-4c6e-b849-f110f02a9efc" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[913ab0e2-25ff-4cfb-8c17-62a29f156eea]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:30 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc Jul 09 15:29:30 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:30 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD" returned: 1 in 0.815s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] 9a4abbed-e35d-4fc9-8ac7-38dab7004c2c was raw, converting to raw {{(pid=86916) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:30 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 Jul 09 15:29:30 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:30 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc" returned: 0 in 0.961s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:30 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc Jul 09 15:29:30 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:31 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc" returned: 0 in 0.934s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:31 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc Jul 09 15:29:31 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:31 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517" returned: 0 in 0.832s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a4abbed-e35d-4fc9-8ac7-38dab7004c2c_6q0y_vsjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:29:31 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:31 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 1G Jul 09 15:29:31 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:31 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d445fa13-4986-4efd-aae6-7b526d49f8cc" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Lock "cinder-quobyte-d445fa13-4986-4efd-aae6-7b526d49f8cc" released by "delete_volume" :: held 1.779s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Created reservations ['9cde93af-85bd-477f-805b-ddf86ddc2d6e', '6324a03b-8480-48db-8ac1-f970ab65c265', 'c920b73b-5fec-44f1-961d-e38305f4c9ca', '613b2324-e754-4a8e-a5ce-723f2e43c315'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:31 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:31 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:31 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-d901728d-3173-4c6e-b849-f110f02a9efc" returned: 0 in 0.819s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-d901728d-3173-4c6e-b849-f110f02a9efc" released by "delete_volume" :: held 1.845s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Created reservations ['d4e324a1-1913-48d8-bdeb-4bf4976799b2', 'e3958f8a-b1bf-4738-bc3c-99f79975876b', 'f14195f8-6507-47c5-9c21-7198a5852c8b', '7911949d-be50-4e21-ba3b-07f86d5939c3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:32 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:32 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Acquiring lock "cinder-16fa2c53-5bfb-4a51-8016-52a66e1cb330-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Lock "cinder-16fa2c53-5bfb-4a51-8016-52a66e1cb330-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Acquiring lock "cinder-quobyte-16fa2c53-5bfb-4a51-8016-52a66e1cb330" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-16fa2c53-5bfb-4a51-8016-52a66e1cb330" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:32 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 1G" returned: 0 in 1.176s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1cc659-cecd-4301-a985-9fa68562e535]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f602ee75-51e2-4a58-acee-e88ef3668206]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:32 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.051s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Deleted volume successfully. Jul 09 15:29:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-8d68f5a1-37dd-4d80-b0f0-9589300750f8 tempest-ProjectReaderTests-308318388 None] Lock "cinder-d445fa13-4986-4efd-aae6-7b526d49f8cc-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:32 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 Jul 09 15:29:32 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:32 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 Jul 09 15:29:32 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:33 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.955s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:33 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:33 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Deleted volume successfully. Jul 09 15:29:33 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-ddb9ceda-fa5a-4496-85b8-ea7994319b83 tempest-VolumeDependencyTests-489292252 None] Lock "cinder-d901728d-3173-4c6e-b849-f110f02a9efc-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:33 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330" returned: 0 in 0.967s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:33 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330 Jul 09 15:29:33 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:33 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517" returned: 0 in 1.094s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:33 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 Jul 09 15:29:33 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:34 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-16fa2c53-5bfb-4a51-8016-52a66e1cb330" returned: 0 in 0.861s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Lock "cinder-quobyte-16fa2c53-5bfb-4a51-8016-52a66e1cb330" released by "delete_volume" :: held 1.887s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Created reservations ['7b6a9017-dd03-4c77-b406-940a9a4fb5d5', '9cc3b263-2246-475c-8a5a-214be11dd32e', '632ff92f-4db4-45a5-91a2-84a3611a36dd', '88decaf8-b655-496f-99e4-572309654720'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:34 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:34 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:34 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517" returned: 1 in 0.982s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Downloaded image 9a4abbed-e35d-4fc9-8ac7-38dab7004c2c ((None, [{'url': 'file:///opt/stack/data/glance/images/9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'metadata': {}}])) to volume 9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 successfully. {{(pid=86916) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Temporary image 9a4abbed-e35d-4fc9-8ac7-38dab7004c2c for user 2ff50feace5c429c8af9b6323b06ac32 is deleted. {{(pid=86916) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG cinder.volume.volume_utils [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Marking volume 9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 as bootable. {{(pid=86916) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Copying metadata from image 9a4abbed-e35d-4fc9-8ac7-38dab7004c2c to 9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517. {{(pid=86916) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 15:29:34 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Creating volume glance metadata for volume 9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 backed by image 9a4abbed-e35d-4fc9-8ac7-38dab7004c2c with: {'image_id': '9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '02e95a3ff7c0948ffbe7ef51eb605371', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86916) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8352c9c-aeb6-4815-894a-c3d28cae23b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517', 'volume_size': 1, 'image_id': '9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02e95a3ff7c0948ffbe7ef51eb605371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '62fd42b38e7d4b39917b11caa52d8eb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4169576ddf5e337a57bbc7ce525611ebb41f90341ed11379c9049d163cf312c1939b2200d304d4301801454f5f3b6a1b1f1c9d82d329e61a17e8909ba4651cc8', 'id': '9a4abbed-e35d-4fc9-8ac7-38dab7004c2c', 'created_at': datetime.datetime(2026, 7, 9, 13, 29, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 13, 29, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a4abbed-e35d-4fc9-8ac7-38dab7004c2c/file', 'properties': {}}, 'image_service': }' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2159865c-bd5c-4915-b0e2-ba4fc507aaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:35 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Volume volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 (9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517): created successfully Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2159865c-bd5c-4915-b0e2-ba4fc507aaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Flow 'volume_create_manager' (0c6346ec-b06a-49af-88f1-e89aede0c65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-36535bd9-e1b4-4e1b-8a4b-990c0d527985 tempest-VolumeImageDependencyTests-1490448530 None] Created volume successfully. Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Acquiring lock "cinder-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Lock "cinder-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:35 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.911s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Acquiring lock "cinder-quobyte-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:35 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Deleted volume successfully. Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Lock "cinder-quobyte-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517" acquired by "delete_volume" :: waited 0.039s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b8a12c81-c7ef-4ae7-af27-e305a3e23e9e tempest-VolumeDependencyTests-489292252 None] Lock "cinder-16fa2c53-5bfb-4a51-8016-52a66e1cb330-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ad3f1c-1057-49e8-ba2c-9ef239fe3e62]: (4, 'raw') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:35 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 Jul 09 15:29:35 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:36 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517" returned: 0 in 1.148s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:36 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 Jul 09 15:29:36 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Flow 'volume_create_manager' (ff7bfdf9-2d94-4847-acd1-bd5905fd0ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f249c8df-ab2f-4c83-a125-1ac2bf420f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f249c8df-ab2f-4c83-a125-1ac2bf420f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-74558928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede6db5c-e05d-4c03-b159-fe3130871079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87b6765c37b412c960c1f45a73b841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:37Z,use_quota=True,user_id='eb7ab9228fac473c8b2a178730b60422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b907223-4222-4f25-97ef-db9639f00cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b907223-4222-4f25-97ef-db9639f00cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b585524b-4264-4c3b-bfce-0dc384b83c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b585524b-4264-4c3b-bfce-0dc384b83c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede6db5c-e05d-4c03-b159-fe3130871079', 'volume_name': 'volume-ede6db5c-e05d-4c03-b159-fe3130871079', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0067b6e-cad1-4f8e-993d-386ae051398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0067b6e-cad1-4f8e-993d-386ae051398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aeb82e-7872-43c9-bf20-57848577036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Volume ede6db5c-e05d-4c03-b159-fe3130871079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede6db5c-e05d-4c03-b159-fe3130871079', 'volume_size': 1} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-74558928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede6db5c-e05d-4c03-b159-fe3130871079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87b6765c37b412c960c1f45a73b841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:37Z,use_quota=True,user_id='eb7ab9228fac473c8b2a178730b60422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Creating volume ede6db5c-e05d-4c03-b159-fe3130871079 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:37 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:37 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079 1073741824 Jul 09 15:29:37 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:37 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517" returned: 1 in 0.868s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517' failed. Not Retrying. {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 15:29:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:37 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517 Jul 09 15:29:37 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:38 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517" returned: 0 in 0.807s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Lock "cinder-quobyte-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517" released by "delete_volume" :: held 2.929s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:38 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079 1073741824" returned: 0 in 1.035s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Created reservations ['049f5a91-77e0-44f6-90ef-f9de447ceadf', 'c1e480b6-0320-4aaa-96af-a027d08f6689', '7a00f0d1-b087-4be5-ae93-fd42d81eeb73', '3572c01c-b9e5-4e2b-b2ac-2bd7adffaf9e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:38 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079 Jul 09 15:29:38 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:38 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:38 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Flow 'volume_create_manager' (26df2f28-e9c6-422d-84bf-db15d1c57dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80bc608-6d9a-48f9-8162-ead7e8cbe778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80bc608-6d9a-48f9-8162-ead7e8cbe778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab909ad-a90a-4feb-83d4-226778d80db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2644acd7aa147fb9f1f7107bbab7e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:39Z,use_quota=True,user_id='f55551891e78412787b0b08ec11bb3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c376ec-5056-481d-9154-855c755fa06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c376ec-5056-481d-9154-855c755fa06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429a9dce-ed57-4ab5-9280-0c36c8741ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429a9dce-ed57-4ab5-9280-0c36c8741ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab909ad-a90a-4feb-83d4-226778d80db5', 'volume_name': 'volume-3ab909ad-a90a-4feb-83d4-226778d80db5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5220a1-874f-4932-8682-a0c4298f6d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5220a1-874f-4932-8682-a0c4298f6d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ec7007-36bd-4f24-a862-08aac430a849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Volume 3ab909ad-a90a-4feb-83d4-226778d80db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab909ad-a90a-4feb-83d4-226778d80db5', 'volume_size': 1} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:39 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079" returned: 0 in 1.003s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab909ad-a90a-4feb-83d4-226778d80db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2644acd7aa147fb9f1f7107bbab7e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:39Z,use_quota=True,user_id='f55551891e78412787b0b08ec11bb3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Creating volume 3ab909ad-a90a-4feb-83d4-226778d80db5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:39 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:39 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.911s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:39 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5 1073741824 Jul 09 15:29:39 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aeb82e-7872-43c9-bf20-57848577036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede6db5c-e05d-4c03-b159-fe3130871079', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447d95de-ad3e-4f4b-9b47-103c3dbc4f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Deleted volume successfully. Jul 09 15:29:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Volume volume-ede6db5c-e05d-4c03-b159-fe3130871079 (ede6db5c-e05d-4c03-b159-fe3130871079): created successfully Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447d95de-ad3e-4f4b-9b47-103c3dbc4f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Flow 'volume_create_manager' (ff7bfdf9-2d94-4847-acd1-bd5905fd0ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-f4dd8352-3672-491c-877c-4b673e97a65e tempest-VolumeImageDependencyTests-1490448530 None] Lock "cinder-9ae97e83-d3a2-4ee5-ab0f-e17ea5ce2517-delete_volume" released by "delete_volume" :: held 4.250s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-deb220b2-c2df-4d60-b26f-e9fe251c2f5a tempest-ProjectReaderTests-1877370937 None] Created volume successfully. Jul 09 15:29:40 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5 1073741824" returned: 0 in 1.045s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:40 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5 Jul 09 15:29:40 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Acquiring lock "cinder-ede6db5c-e05d-4c03-b159-fe3130871079-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Lock "cinder-ede6db5c-e05d-4c03-b159-fe3130871079-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Acquiring lock "cinder-quobyte-ede6db5c-e05d-4c03-b159-fe3130871079" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Lock "cinder-quobyte-ede6db5c-e05d-4c03-b159-fe3130871079" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[441ed2e8-e0e1-4238-b203-d14f82fc5dcc]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:41 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079 Jul 09 15:29:41 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:41 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5" returned: 0 in 0.787s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ec7007-36bd-4f24-a862-08aac430a849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab909ad-a90a-4feb-83d4-226778d80db5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d53bbc7-9030-487f-add1-06c402cdbe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Volume volume-3ab909ad-a90a-4feb-83d4-226778d80db5 (3ab909ad-a90a-4feb-83d4-226778d80db5): created successfully Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d53bbc7-9030-487f-add1-06c402cdbe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Flow 'volume_create_manager' (26df2f28-e9c6-422d-84bf-db15d1c57dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e388a5ec-bd4b-415e-b5c1-3b6793f5abbc tempest-CinderUnicodeTest-373318993 None] Created volume successfully. Jul 09 15:29:41 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079" returned: 0 in 0.875s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:42 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079 Jul 09 15:29:42 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:42 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ede6db5c-e05d-4c03-b159-fe3130871079" returned: 0 in 0.773s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Lock "cinder-quobyte-ede6db5c-e05d-4c03-b159-fe3130871079" released by "delete_volume" :: held 1.703s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Created reservations ['bacbb4a7-01a3-494a-935b-a1d23412f680', 'a208f558-0df9-4b36-b2f9-3de4ca46d5c7', 'cd7b03eb-5dda-49b7-a3dd-afd6c3cfb036', '6f7e305e-e9b1-48ba-a908-536097cfb49f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:42 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:42 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:42 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Flow 'volume_create_manager' (f68561a8-068b-4fcd-803e-a68d1f1b1159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7353ea49-4abc-4ea4-8e11-a3334d6ed612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7353ea49-4abc-4ea4-8e11-a3334d6ed612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1196867924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b01d7ab-d222-4f26-a8f8-ba2c00795ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2644acd7aa147fb9f1f7107bbab7e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:43Z,use_quota=True,user_id='f55551891e78412787b0b08ec11bb3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55dc2b6-fb99-41e1-80d4-ef13ce182b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55dc2b6-fb99-41e1-80d4-ef13ce182b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f4bb71-d8dd-4e62-ae24-8418367b522b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f4bb71-d8dd-4e62-ae24-8418367b522b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b01d7ab-d222-4f26-a8f8-ba2c00795ba2', 'volume_name': 'volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39ca2fb-39e1-4aa4-94e5-fb57589812ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39ca2fb-39e1-4aa4-94e5-fb57589812ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d34aabe-ce88-4c6d-b2fd-8f4c7e2bc807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Volume 4b01d7ab-d222-4f26-a8f8-ba2c00795ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2', 'volume_size': 1} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1196867924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b01d7ab-d222-4f26-a8f8-ba2c00795ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2644acd7aa147fb9f1f7107bbab7e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:43Z,use_quota=True,user_id='f55551891e78412787b0b08ec11bb3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Creating volume 4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:43 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:43 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 1073741824 Jul 09 15:29:43 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:43 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.721s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Deleted volume successfully. Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-39c5ddab-107f-48b8-a33c-224e3f1eb3b7 tempest-ProjectReaderTests-1877370937 None] Lock "cinder-ede6db5c-e05d-4c03-b159-fe3130871079-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Flow 'volume_create_manager' (fc14b952-a06a-44a8-b1a7-e28cd0a6adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2aeca5a-9472-4fd2-b421-63f32576aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2aeca5a-9472-4fd2-b421-63f32576aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084287301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dac2af3-e1a7-4fea-97ef-891f0a068d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87b6765c37b412c960c1f45a73b841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:44Z,use_quota=True,user_id='eb7ab9228fac473c8b2a178730b60422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a83c8e-9779-464f-a89d-06d021f85455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a83c8e-9779-464f-a89d-06d021f85455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0da862-ac74-4688-8caa-f2d81d605ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0da862-ac74-4688-8caa-f2d81d605ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dac2af3-e1a7-4fea-97ef-891f0a068d69', 'volume_name': 'volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d95318-03f9-41ce-87dc-511d72b42068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d95318-03f9-41ce-87dc-511d72b42068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d2837a-93d9-4724-b723-b7ba7e085711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Volume 1dac2af3-e1a7-4fea-97ef-891f0a068d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69', 'volume_size': 1} Jul 09 15:29:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:44 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 1073741824" returned: 0 in 0.974s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:44 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 Jul 09 15:29:44 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:44 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" returned: 0 in 0.765s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084287301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dac2af3-e1a7-4fea-97ef-891f0a068d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87b6765c37b412c960c1f45a73b841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:44Z,use_quota=True,user_id='eb7ab9228fac473c8b2a178730b60422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Creating volume 1dac2af3-e1a7-4fea-97ef-891f0a068d69 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:44 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:44 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69 1073741824 Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d34aabe-ce88-4c6d-b2fd-8f4c7e2bc807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:44 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f681ca25-8888-4d27-a154-e0d1733c6de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:44 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Volume volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 (4b01d7ab-d222-4f26-a8f8-ba2c00795ba2): created successfully Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f681ca25-8888-4d27-a154-e0d1733c6de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:44 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Flow 'volume_create_manager' (f68561a8-068b-4fcd-803e-a68d1f1b1159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:44 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-21ac6f2e-7f31-4ebf-8021-bfce6c027654 tempest-CinderUnicodeTest-373318993 None] Created volume successfully. Jul 09 15:29:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:45 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69 1073741824" returned: 0 in 0.933s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:45 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69 Jul 09 15:29:45 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:46 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69" returned: 0 in 0.776s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.207s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Creating offline snapshot 38409c46-865b-4bb7-b27a-11fe8a4eb4b0 of volume 4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d2837a-93d9-4724-b723-b7ba7e085711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68bce35-ab00-4d9a-8068-91eecf2ec9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49159c5-ef31-4c78-9848-89ea9fcb9a04]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:46 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Volume volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69 (1dac2af3-e1a7-4fea-97ef-891f0a068d69): created successfully Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68bce35-ab00-4d9a-8068-91eecf2ec9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:46 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Flow 'volume_create_manager' (fc14b952-a06a-44a8-b1a7-e28cd0a6adf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cc714fe3-8b44-4a1b-bfcc-aa1fe534482d tempest-ProjectReaderTests-1877370937 None] Created volume successfully. Jul 09 15:29:46 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 Jul 09 15:29:46 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Acquiring lock "cinder-1dac2af3-e1a7-4fea-97ef-891f0a068d69-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Lock "cinder-1dac2af3-e1a7-4fea-97ef-891f0a068d69-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Acquiring lock "cinder-quobyte-1dac2af3-e1a7-4fea-97ef-891f0a068d69" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Lock "cinder-quobyte-1dac2af3-e1a7-4fea-97ef-891f0a068d69" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e69151-4a9b-4ef6-b574-e2e6b83969cf]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:47 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69 Jul 09 15:29:47 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:47 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" returned: 0 in 0.845s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:47 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 1G Jul 09 15:29:47 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:47 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:47 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:48 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69" returned: 0 in 0.828s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:48 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69 Jul 09 15:29:48 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:48 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 1G" returned: 0 in 1.083s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:48 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.902s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:29:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:29:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:29:48 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 Jul 09 15:29:48 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:48 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1dac2af3-e1a7-4fea-97ef-891f0a068d69" returned: 0 in 0.948s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Lock "cinder-quobyte-1dac2af3-e1a7-4fea-97ef-891f0a068d69" released by "delete_volume" :: held 1.824s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:49 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Created reservations ['c0f33e46-ce15-4c2a-8bec-b3ddb541a620', 'dc34898e-5f6f-44ac-b137-57f3482c530b', '70933eee-e307-4a1a-99c5-05cd775059ac', '04302499-f12a-4de0-aa07-145f1bf9773c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:49 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:49 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:49 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0" returned: 0 in 1.090s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:49 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 is being set with open permissions: ugo+rw Jul 09 15:29:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:49 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 Jul 09 15:29:49 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:50 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 1.005s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Deleted volume successfully. Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Flow 'volume_create_manager' (27521d4b-2c32-467c-95d1-5b8a87e11377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515eb724-735e-4a0f-b95b-574b04819e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515eb724-735e-4a0f-b95b-574b04819e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452380702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecfcd39-9f51-44df-8984-0bff75f1c105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87b6765c37b412c960c1f45a73b841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:50Z,use_quota=True,user_id='eb7ab9228fac473c8b2a178730b60422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62727386-700b-473f-b94a-1075fd57186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62727386-700b-473f-b94a-1075fd57186c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d360e6e-be53-49b5-99f9-51acc460dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d360e6e-be53-49b5-99f9-51acc460dc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ecfcd39-9f51-44df-8984-0bff75f1c105', 'volume_name': 'volume-9ecfcd39-9f51-44df-8984-0bff75f1c105', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c14438-30e9-48c4-91b3-aa4be5b140e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c14438-30e9-48c4-91b3-aa4be5b140e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70a92e1-302b-410c-99f6-c3c2380190b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Volume 9ecfcd39-9f51-44df-8984-0bff75f1c105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ecfcd39-9f51-44df-8984-0bff75f1c105', 'volume_size': 1} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-fd7be729-902a-4347-bb70-d192fde77a7a tempest-ProjectReaderTests-1877370937 None] Lock "cinder-1dac2af3-e1a7-4fea-97ef-891f0a068d69-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:50 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0" returned: 0 in 0.984s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:50 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.info Jul 09 15:29:50 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:51 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.info" returned: 0 in 0.784s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:51 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.info is being set with open permissions: ugo+rw Jul 09 15:29:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:51 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.info Jul 09 15:29:51 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:52 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.info" returned: 0 in 0.685s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.594s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.884s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452380702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecfcd39-9f51-44df-8984-0bff75f1c105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87b6765c37b412c960c1f45a73b841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:50Z,use_quota=True,user_id='eb7ab9228fac473c8b2a178730b60422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Creating volume 9ecfcd39-9f51-44df-8984-0bff75f1c105 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:52 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:52 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105 1073741824 Jul 09 15:29:52 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-73669297-0396-42cf-9cd9-143bbe2e9303 tempest-CinderUnicodeTest-373318993 None] Create snapshot completed successfully Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Acquiring lock "cinder-38409c46-865b-4bb7-b27a-11fe8a4eb4b0-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Lock "cinder-38409c46-865b-4bb7-b27a-11fe8a4eb4b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Acquiring lock "cinder-quobyte-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Lock "cinder-quobyte-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Acquiring lock "cinder-quobyte-38409c46-865b-4bb7-b27a-11fe8a4eb4b0" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Lock "cinder-quobyte-38409c46-865b-4bb7-b27a-11fe8a4eb4b0" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Deleting offline snapshot 38409c46-865b-4bb7-b27a-11fe8a4eb4b0 of volume 4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] snapshot_file for this snap is: volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a9f0fd-0312-479e-b08d-82c7fabec526]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:53 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 Jul 09 15:29:53 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:53 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105 1073741824" returned: 0 in 1.041s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:53 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105 Jul 09 15:29:53 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:53 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0" returned: 0 in 0.932s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:29:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee799c3-534b-4999-9171-9e718567c9c8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:54 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 Jul 09 15:29:54 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:54 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105" returned: 0 in 0.761s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70a92e1-302b-410c-99f6-c3c2380190b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecfcd39-9f51-44df-8984-0bff75f1c105', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728298fe-bb5f-4a11-825f-26dfa1b42443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Volume volume-9ecfcd39-9f51-44df-8984-0bff75f1c105 (9ecfcd39-9f51-44df-8984-0bff75f1c105): created successfully Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728298fe-bb5f-4a11-825f-26dfa1b42443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Flow 'volume_create_manager' (27521d4b-2c32-467c-95d1-5b8a87e11377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-8167a4bc-5ded-4c86-9a82-4520eb1217d7 tempest-ProjectReaderTests-1877370937 None] Created volume successfully. Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Acquiring lock "cinder-9ecfcd39-9f51-44df-8984-0bff75f1c105-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Lock "cinder-9ecfcd39-9f51-44df-8984-0bff75f1c105-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Acquiring lock "cinder-quobyte-9ecfcd39-9f51-44df-8984-0bff75f1c105" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Lock "cinder-quobyte-9ecfcd39-9f51-44df-8984-0bff75f1c105" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c67e3b6-b58c-4d0a-9235-ada09ad781d0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:54 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105 Jul 09 15:29:54 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:54 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" returned: 0 in 0.942s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:54 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 Jul 09 15:29:54 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:55 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105" returned: 0 in 0.997s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:55 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105 Jul 09 15:29:55 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:55 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0" returned: 0 in 1.025s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:55 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0 Jul 09 15:29:55 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:56 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-9ecfcd39-9f51-44df-8984-0bff75f1c105" returned: 0 in 0.719s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Lock "cinder-quobyte-9ecfcd39-9f51-44df-8984-0bff75f1c105" released by "delete_volume" :: held 1.761s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Created reservations ['a6870d71-1d73-4550-8b35-32981d5e96b1', '823bc997-4748-45b0-a536-2c7fb25372d9', '04c8d64e-4599-4b60-9048-fb7ff5ab4b55', 'aed30925-a247-44fb-a68b-468e968c1f44'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:56 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2.38409c46-865b-4bb7-b27a-11fe8a4eb4b0" returned: 0 in 0.689s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:56 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:56 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Lock "cinder-quobyte-38409c46-865b-4bb7-b27a-11fe8a4eb4b0" released by "_delete_snapshot" :: held 3.743s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Lock "cinder-quobyte-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" released by "delete_snapshot" :: held 3.789s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Created reservations ['3e107150-f8c7-4733-8982-c10b029f3c6f', 'ad6e2237-8b25-4658-a97e-13ccf52cbc27', 'edaa14c4-21d4-47cb-9ff7-a06b4ca49a04', 'bbe59962-d866-4a5e-ba44-87743a314110'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Delete snapshot completed successfully. Jul 09 15:29:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b794a554-1157-46e2-a59e-f4cbf494463a tempest-CinderUnicodeTest-373318993 None] Lock "cinder-38409c46-865b-4bb7-b27a-11fe8a4eb4b0-delete_snapshot" released by "delete_snapshot" :: held 3.966s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Acquiring lock "cinder-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Lock "cinder-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:57 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.902s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:29:57 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Deleted volume successfully. Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-edade076-6ee6-4b6e-91ad-ab95cd8977af tempest-ProjectReaderTests-1877370937 None] Lock "cinder-9ecfcd39-9f51-44df-8984-0bff75f1c105-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Acquiring lock "cinder-quobyte-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Lock "cinder-quobyte-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988aaa6-833d-4644-aeea-511d43a4b19c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Flow 'volume_create_manager' (c30fd322-900b-4462-991e-1bb379413f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09aabd3-26b7-4031-98fa-6b2eaff144f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09aabd3-26b7-4031-98fa-6b2eaff144f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-785846253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad93fd1-d576-436a-bf83-592f6d0a25a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87b6765c37b412c960c1f45a73b841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:58Z,use_quota=True,user_id='eb7ab9228fac473c8b2a178730b60422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3e7c1f-2035-460b-9894-b944d4a679b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3e7c1f-2035-460b-9894-b944d4a679b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:57 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 Jul 09 15:29:57 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3866d01-3b41-4388-81e2-00a4db743e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3866d01-3b41-4388-81e2-00a4db743e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad93fd1-d576-436a-bf83-592f6d0a25a0', 'volume_name': 'volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf15431a-350c-4922-845f-2a8cb90cb54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf15431a-350c-4922-845f-2a8cb90cb54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeacb9af-65ba-477b-a65b-899fb8a758e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:57 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Volume 4ad93fd1-d576-436a-bf83-592f6d0a25a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0', 'volume_size': 1} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-785846253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad93fd1-d576-436a-bf83-592f6d0a25a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87b6765c37b412c960c1f45a73b841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:29:58Z,use_quota=True,user_id='eb7ab9228fac473c8b2a178730b60422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Creating volume 4ad93fd1-d576-436a-bf83-592f6d0a25a0 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:29:57 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:29:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:57 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0 1073741824 Jul 09 15:29:57 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:58 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" returned: 0 in 0.876s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:58 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2 Jul 09 15:29:58 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:58 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0 1073741824" returned: 0 in 0.936s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:58 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0 Jul 09 15:29:58 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:59 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" returned: 0 in 0.708s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Lock "cinder-quobyte-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2" released by "delete_volume" :: held 1.668s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Created reservations ['e91efe74-f116-419f-b9bf-9e46912d9b08', '21742673-2bdf-48be-a5f5-49564d57c101', '3e64df26-c484-4343-b726-0d7cc3c9ce59', 'a4445986-18ba-4148-aa90-69602452d06f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:59 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:29:59 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:29:59 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0" returned: 0 in 0.697s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeacb9af-65ba-477b-a65b-899fb8a758e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d14b948-1d97-482f-b1dc-8c02b94fb64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:29:59 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Volume volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0 (4ad93fd1-d576-436a-bf83-592f6d0a25a0): created successfully Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d14b948-1d97-482f-b1dc-8c02b94fb64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Flow 'volume_create_manager' (c30fd322-900b-4462-991e-1bb379413f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:29:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a809c1d8-f579-4827-8ca0-dd63c949d7e2 tempest-ProjectReaderTests-1877370937 None] Created volume successfully. Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Acquiring lock "cinder-3ab909ad-a90a-4feb-83d4-226778d80db5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Lock "cinder-3ab909ad-a90a-4feb-83d4-226778d80db5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Acquiring lock "cinder-quobyte-3ab909ad-a90a-4feb-83d4-226778d80db5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Lock "cinder-quobyte-3ab909ad-a90a-4feb-83d4-226778d80db5" acquired by "delete_volume" :: waited 0.031s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[317e4b94-0a8a-4f87-9499-3bd36b8584b1]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:29:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:29:59 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5 Jul 09 15:29:59 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:00 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.694s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:30:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Deleted volume successfully. Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e21fb90d-ba5b-4927-a479-df71ad0989ec tempest-CinderUnicodeTest-373318993 None] Lock "cinder-4b01d7ab-d222-4f26-a8f8-ba2c00795ba2-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:00 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5" returned: 0 in 0.826s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:00 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5 Jul 09 15:30:00 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Acquiring lock "cinder-4ad93fd1-d576-436a-bf83-592f6d0a25a0-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Lock "cinder-4ad93fd1-d576-436a-bf83-592f6d0a25a0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Acquiring lock "cinder-quobyte-4ad93fd1-d576-436a-bf83-592f6d0a25a0" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Lock "cinder-quobyte-4ad93fd1-d576-436a-bf83-592f6d0a25a0" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba70c7d-5c16-4c7c-9343-613559574d9d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:01 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0 Jul 09 15:30:01 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:01 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3ab909ad-a90a-4feb-83d4-226778d80db5" returned: 0 in 0.762s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Lock "cinder-quobyte-3ab909ad-a90a-4feb-83d4-226778d80db5" released by "delete_volume" :: held 1.644s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Created reservations ['03d5d3c3-6f3f-4b6d-8cea-5faed94d9145', '9e68a559-a3d8-483c-b3f9-9b9e0ea14de7', '09009b05-b873-4238-bf4d-ecfc76812718', 'de46df8a-6be3-42d2-9c31-a9e60093a70c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:01 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:30:01 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:01 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0" returned: 0 in 0.841s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:01 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0 Jul 09 15:30:01 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:02 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.793s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:30:02 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Deleted volume successfully. Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e37d3bb7-e447-4246-a42b-01e62a250359 tempest-CinderUnicodeTest-373318993 None] Lock "cinder-3ab909ad-a90a-4feb-83d4-226778d80db5-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:02 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4ad93fd1-d576-436a-bf83-592f6d0a25a0" returned: 0 in 0.757s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Lock "cinder-quobyte-4ad93fd1-d576-436a-bf83-592f6d0a25a0" released by "delete_volume" :: held 1.668s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Created reservations ['6a81000e-f7fb-4ec3-b6a9-a3bc36abb548', '3c6f7a01-0f2b-425b-90b8-a8fc1946b289', '26e4b80f-e365-47dc-9b2f-f26994080c14', '954c195b-f084-492f-bd26-cd59b8018a9a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:02 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:30:02 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:03 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.749s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:30:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Deleted volume successfully. Jul 09 15:30:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a38ed240-78fa-4e11-8078-313be1385c42 tempest-ProjectReaderTests-1877370937 None] Lock "cinder-4ad93fd1-d576-436a-bf83-592f6d0a25a0-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-1e87f660-0459-4d91-b1c7-fe98b4b23942 tempest-ProjectAdminTests-1702827788 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755428314209, 'free_capacity_gb': 1775.755428314209, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86916) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 15:30:12 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:UPDATE=133,cinder:SELECT=84,cinder:INSERT=35,cinder:DELETE=11 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:30:13 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=106,cinder:UPDATE=132,cinder:DELETE=10,cinder:INSERT=38 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (3e441c05-1273-4d37-b807-eaff4d50bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169b93aa-bb7d-421f-9b1a-62d2b58194a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169b93aa-bb7d-421f-9b1a-62d2b58194a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-460275868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3541d940-3f86-4e88-8d8b-fe72001fe28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:30:16Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56ae438-0373-4b2c-97ae-1fd6149728d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56ae438-0373-4b2c-97ae-1fd6149728d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a0106b-3e47-4bfe-aa4b-0167305565b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a0106b-3e47-4bfe-aa4b-0167305565b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3541d940-3f86-4e88-8d8b-fe72001fe28b', 'volume_name': 'volume-3541d940-3f86-4e88-8d8b-fe72001fe28b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7e8ad5-f97b-4c49-883a-0d79507b339b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7e8ad5-f97b-4c49-883a-0d79507b339b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee152d0-94f5-4fa2-8dcb-58cf6cccb53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:15 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Volume 3541d940-3f86-4e88-8d8b-fe72001fe28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3541d940-3f86-4e88-8d8b-fe72001fe28b', 'volume_size': 1} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-460275868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3541d940-3f86-4e88-8d8b-fe72001fe28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:30:16Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Creating volume 3541d940-3f86-4e88-8d8b-fe72001fe28b {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:30:15 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:30:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:15 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b 1073741824 Jul 09 15:30:15 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:16 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b 1073741824" returned: 0 in 0.871s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:16 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b Jul 09 15:30:16 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:17 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b" returned: 0 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:30:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee152d0-94f5-4fa2-8dcb-58cf6cccb53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3541d940-3f86-4e88-8d8b-fe72001fe28b', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5f74e6-51ab-441c-ab8a-22e662f92e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Volume volume-3541d940-3f86-4e88-8d8b-fe72001fe28b (3541d940-3f86-4e88-8d8b-fe72001fe28b): created successfully Jul 09 15:30:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5f74e6-51ab-441c-ab8a-22e662f92e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (3e441c05-1273-4d37-b807-eaff4d50bc14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:30:17 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-092afac3-6d9e-48ea-b343-0b98955eaabb tempest-ProjectMemberTests-2108537287 None] Created volume successfully. Jul 09 15:30:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Creating offline snapshot 46d6aaf7-a639-494c-a3c7-ad331c8af950 of volume 3541d940-3f86-4e88-8d8b-fe72001fe28b {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:30:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f4db51-9dcd-46a8-8c0a-97410adc04e9]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:18 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b Jul 09 15:30:18 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:18 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b" returned: 0 in 0.779s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:19 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 1G Jul 09 15:30:19 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:19 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 1G" returned: 0 in 0.804s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3541d940-3f86-4e88-8d8b-fe72001fe28b -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:19 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3541d940-3f86-4e88-8d8b-fe72001fe28b -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 Jul 09 15:30:19 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:20 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3541d940-3f86-4e88-8d8b-fe72001fe28b -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950" returned: 0 in 0.744s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:20 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 is being set with open permissions: ugo+rw Jul 09 15:30:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:20 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 Jul 09 15:30:20 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:21 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950" returned: 0 in 0.710s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:21 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.info Jul 09 15:30:21 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:22 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.info" returned: 0 in 0.748s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:22 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.info is being set with open permissions: ugo+rw Jul 09 15:30:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:22 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.info Jul 09 15:30:22 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:22 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.info" returned: 0 in 0.635s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.581s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:22 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-72751a6c-12ce-416e-b19f-8bb17132f98d tempest-ProjectMemberTests-2108537287 None] Create snapshot completed successfully Jul 09 15:30:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-46d6aaf7-a639-494c-a3c7-ad331c8af950-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-46d6aaf7-a639-494c-a3c7-ad331c8af950-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-3541d940-3f86-4e88-8d8b-fe72001fe28b" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-3541d940-3f86-4e88-8d8b-fe72001fe28b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-46d6aaf7-a639-494c-a3c7-ad331c8af950" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-46d6aaf7-a639-494c-a3c7-ad331c8af950" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Deleting offline snapshot 46d6aaf7-a639-494c-a3c7-ad331c8af950 of volume 3541d940-3f86-4e88-8d8b-fe72001fe28b {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:30:23 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] snapshot_file for this snap is: volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:30:23 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[718f5ea3-21e3-432c-b85a-9273cf4e06cd]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:23 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 Jul 09 15:30:23 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:24 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950" returned: 0 in 0.811s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3541d940-3f86-4e88-8d8b-fe72001fe28b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:30:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2270fa6-b034-46d0-80f6-1dab6cef95f4]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:24 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b Jul 09 15:30:24 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:25 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b" returned: 0 in 0.788s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:25 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 Jul 09 15:30:25 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:25 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950" returned: 0 in 0.743s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:25 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950 Jul 09 15:30:25 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:26 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b.46d6aaf7-a639-494c-a3c7-ad331c8af950" returned: 0 in 0.664s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-46d6aaf7-a639-494c-a3c7-ad331c8af950" released by "_delete_snapshot" :: held 3.122s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-3541d940-3f86-4e88-8d8b-fe72001fe28b" released by "delete_snapshot" :: held 3.149s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:26 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Created reservations ['2c55b6c8-0725-4aa2-b868-9d4931d292ab', '2ab80917-1ec0-414d-97f5-dcbab7211355', 'db55c36a-dee7-4fd0-920f-6298fbb55263', '445fc74e-4406-47f8-aa57-3f608715394a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:30:26 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Delete snapshot completed successfully. Jul 09 15:30:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3e7d3dcc-601c-40ed-afae-78f7fa8ff594 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-46d6aaf7-a639-494c-a3c7-ad331c8af950-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-3541d940-3f86-4e88-8d8b-fe72001fe28b-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-3541d940-3f86-4e88-8d8b-fe72001fe28b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-3541d940-3f86-4e88-8d8b-fe72001fe28b" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-3541d940-3f86-4e88-8d8b-fe72001fe28b" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[485c04f0-9722-4c79-95e7-335d43d99b4e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:27 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b Jul 09 15:30:27 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Flow 'volume_create_manager' (85e95c92-92f4-467d-a761-ca7ce8ea8cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:30:28 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d22dac-cfe4-41c7-bdaa-28a175d847d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b" returned: 0 in 0.775s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:28 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b Jul 09 15:30:28 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d22dac-cfe4-41c7-bdaa-28a175d847d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1626427912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f02925-6d36-4558-ae05-e99159acdbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6359b9cc96864e6bb39e8dad8a3e27d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:30:29Z,use_quota=True,user_id='f6a5f7e57d8f47c4a7dbff283ed3262a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d367ec9e-10c7-48d3-b87f-e1008ee890ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d367ec9e-10c7-48d3-b87f-e1008ee890ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3624276b-d7ee-497c-9a4d-efb3fbcab3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3624276b-d7ee-497c-9a4d-efb3fbcab3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f02925-6d36-4558-ae05-e99159acdbfc', 'volume_name': 'volume-89f02925-6d36-4558-ae05-e99159acdbfc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8733b6d2-342e-4176-b143-fe49b5584398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8733b6d2-342e-4176-b143-fe49b5584398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aefc1fc-f082-4e19-8b0c-71b4868d7ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Volume 89f02925-6d36-4558-ae05-e99159acdbfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f02925-6d36-4558-ae05-e99159acdbfc', 'volume_size': 1} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1626427912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f02925-6d36-4558-ae05-e99159acdbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6359b9cc96864e6bb39e8dad8a3e27d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:30:29Z,use_quota=True,user_id='f6a5f7e57d8f47c4a7dbff283ed3262a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Creating volume 89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:30:28 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:30:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:28 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc 1073741824 Jul 09 15:30:28 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:29 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3541d940-3f86-4e88-8d8b-fe72001fe28b" returned: 0 in 0.636s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-3541d940-3f86-4e88-8d8b-fe72001fe28b" released by "delete_volume" :: held 1.481s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Created reservations ['13dc4ab4-c860-4e93-ae83-4d6fe66c4806', 'aef31d58-da73-447f-974a-7743f120b95a', '9bbb9703-9242-49c5-85f8-57567f2c3463', '9d490692-d2a0-4841-9bef-c7e9bf88d734'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:29 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:30:29 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:29 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc 1073741824" returned: 0 in 0.875s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:29 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc Jul 09 15:30:29 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:30 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.684s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:30:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Deleted volume successfully. Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-25807175-afff-41dd-aaa6-2ed467de06d4 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-3541d940-3f86-4e88-8d8b-fe72001fe28b-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:30 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc" returned: 0 in 0.683s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aefc1fc-f082-4e19-8b0c-71b4868d7ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f02925-6d36-4558-ae05-e99159acdbfc', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999165a7-f283-40a5-a186-dd7e24a21c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Volume volume-89f02925-6d36-4558-ae05-e99159acdbfc (89f02925-6d36-4558-ae05-e99159acdbfc): created successfully Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999165a7-f283-40a5-a186-dd7e24a21c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Flow 'volume_create_manager' (85e95c92-92f4-467d-a761-ca7ce8ea8cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:30:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7f42f210-2a6b-4e98-9ec1-4782182d7032 tempest-SnapshotDependencyTests-1661988039 None] Created volume successfully. Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (0bd69c1a-39cd-4c02-ba72-2b30f4ee203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a9f5ad-7a95-40a3-993b-77f1fe02435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a9f5ad-7a95-40a3-993b-77f1fe02435c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316750013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc21ee9-55d2-432e-8bad-b8173ecc0ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:30:30Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a5c08b-6993-4d93-b217-cf67270ce084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a5c08b-6993-4d93-b217-cf67270ce084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b51f52b-8410-4f17-8d5f-917a641580b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b51f52b-8410-4f17-8d5f-917a641580b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc21ee9-55d2-432e-8bad-b8173ecc0ec2', 'volume_name': 'volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686c5501-4ead-447c-8f3f-e08b02e12a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686c5501-4ead-447c-8f3f-e08b02e12a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6594b1b7-ecf4-4eb2-bcde-b2630cf369bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Volume 4cc21ee9-55d2-432e-8bad-b8173ecc0ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2', 'volume_size': 1} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316750013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc21ee9-55d2-432e-8bad-b8173ecc0ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:30:30Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Creating volume 4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:30:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:30 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 1073741824 Jul 09 15:30:30 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:31 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 1073741824" returned: 0 in 0.831s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:31 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 Jul 09 15:30:31 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:31 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" returned: 0 in 0.636s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:30:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.109s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6594b1b7-ecf4-4eb2-bcde-b2630cf369bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954ad7cf-5598-46cf-9aff-88f6cb7f10f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Creating offline snapshot fde0221c-24b3-43ef-b0dc-549ee8da353e of volume 89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:30:32 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Volume volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 (4cc21ee9-55d2-432e-8bad-b8173ecc0ec2): created successfully Jul 09 15:30:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954ad7cf-5598-46cf-9aff-88f6cb7f10f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:32 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (0bd69c1a-39cd-4c02-ba72-2b30f4ee203a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:30:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[554a53a8-6366-4847-bf6c-13411236c1b3]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-908bb70a-66e8-459f-801c-50d613fd1862 tempest-ProjectMemberTests-2108537287 None] Created volume successfully. Jul 09 15:30:32 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc Jul 09 15:30:32 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:32 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc" returned: 0 in 0.756s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:32 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e 1G Jul 09 15:30:32 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:33 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e 1G" returned: 0 in 0.792s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f02925-6d36-4558-ae05-e99159acdbfc -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:33 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f02925-6d36-4558-ae05-e99159acdbfc -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e Jul 09 15:30:33 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:34 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f02925-6d36-4558-ae05-e99159acdbfc -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e" returned: 0 in 0.664s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:34 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e is being set with open permissions: ugo+rw Jul 09 15:30:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:34 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e Jul 09 15:30:34 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:34 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e" returned: 0 in 0.659s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:34 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.info Jul 09 15:30:34 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:35 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.info" returned: 0 in 0.652s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:35 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.info is being set with open permissions: ugo+rw Jul 09 15:30:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:35 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.info Jul 09 15:30:35 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:36 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.info" returned: 0 in 0.626s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.254s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.620s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:36 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Creating offline snapshot b497f838-445c-47c7-86a6-656889867c25 of volume 4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:30:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a1ffbb1c-2403-403d-9ae4-f194dba065d1 tempest-SnapshotDependencyTests-1661988039 None] Create snapshot completed successfully Jul 09 15:30:36 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386b25e-9b6d-4fa8-a4ee-d4176e4589de]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:36 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 Jul 09 15:30:36 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:37 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" returned: 0 in 0.738s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:37 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 1G Jul 09 15:30:37 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Flow 'volume_create_manager' (4ba91e11-62cd-4786-93a0-de911b36120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10132d20-de3d-40e1-96c7-192fae36a384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10132d20-de3d-40e1-96c7-192fae36a384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5799bd3e-ceb9-4786-9183-e0d30824c6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6359b9cc96864e6bb39e8dad8a3e27d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fde0221c-24b3-43ef-b0dc-549ee8da353e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:30:38Z,use_quota=True,user_id='f6a5f7e57d8f47c4a7dbff283ed3262a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2036f4a-31d5-4d56-83a7-e3208d8e038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2036f4a-31d5-4d56-83a7-e3208d8e038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69692255-30a2-4610-a4b9-3f69d6d345eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69692255-30a2-4610-a4b9-3f69d6d345eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5799bd3e-ceb9-4786-9183-e0d30824c6ea', 'volume_name': 'volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea', 'volume_size': 1, 'snapshot_id': 'fde0221c-24b3-43ef-b0dc-549ee8da353e'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2470586d-cf93-4278-be4b-aa42c1a2aef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2470586d-cf93-4278-be4b-aa42c1a2aef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c60e755-8b48-4b87-ad03-a362b5b8492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:37 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Volume 5799bd3e-ceb9-4786-9183-e0d30824c6ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea', 'volume_size': 1, 'snapshot_id': 'fde0221c-24b3-43ef-b0dc-549ee8da353e'} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:37 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 1G" returned: 0 in 0.821s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:37 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 Jul 09 15:30:37 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:38 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25" returned: 0 in 0.662s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:38 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 is being set with open permissions: ugo+rw Jul 09 15:30:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:38 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 Jul 09 15:30:38 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:39 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25" returned: 0 in 0.634s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:39 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.info Jul 09 15:30:39 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:39 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.info" returned: 0 in 0.642s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:39 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.info is being set with open permissions: ugo+rw Jul 09 15:30:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:39 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.info Jul 09 15:30:39 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:40 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.info" returned: 0 in 0.629s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.213s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.667s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "cinder-quobyte-fde0221c-24b3-43ef-b0dc-549ee8da353e-5799bd3e-ceb9-4786-9183-e0d30824c6ea" by "_create_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-fde0221c-24b3-43ef-b0dc-549ee8da353e-5799bd3e-ceb9-4786-9183-e0d30824c6ea" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Creating volume 5799bd3e-ceb9-4786-9183-e0d30824c6ea from snapshot fde0221c-24b3-43ef-b0dc-549ee8da353e {{(pid=86916) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "cinder-quobyte-5799bd3e-ceb9-4786-9183-e0d30824c6ea" by "_copy_volume_from_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4bf672aa-06af-4a45-aadd-a1dca2952ba1 tempest-ProjectMemberTests-2108537287 None] Create snapshot completed successfully Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-5799bd3e-ceb9-4786-9183-e0d30824c6ea" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] snapshot: fde0221c-24b3-43ef-b0dc-549ee8da353e, volume: 5799bd3e-ceb9-4786-9183-e0d30824c6ea, {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d086d77-11c0-4718-a901-91cf2af2cc4c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:40 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e Jul 09 15:30:40 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-b497f838-445c-47c7-86a6-656889867c25-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-b497f838-445c-47c7-86a6-656889867c25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-b497f838-445c-47c7-86a6-656889867c25" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-b497f838-445c-47c7-86a6-656889867c25" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Deleting offline snapshot b497f838-445c-47c7-86a6-656889867c25 of volume 4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] snapshot_file for this snap is: volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[016e3d72-8b68-42f9-9965-0cc205cae5f0]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:41 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 Jul 09 15:30:41 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:41 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e" returned: 0 in 0.772s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89f02925-6d36-4558-ae05-e99159acdbfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:30:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] will copy from snapshot at /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 15:30:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Creating direct copy from snapshot {{(pid=86916) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 15:30:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa791d1-9ae2-48a5-9487-99a355f05c15]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:41 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc Jul 09 15:30:41 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:41 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25" returned: 0 in 0.773s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:30:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bf836f-057d-4b52-850f-b8c843825fd8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:41 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 Jul 09 15:30:41 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:42 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc" returned: 0 in 0.783s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:42 devstack cinder-volume[86916]: DEBUG cinder.utils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Path /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea not found in is_blk_device check {{(pid=86916) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 15:30:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:42 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea Jul 09 15:30:42 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:42 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:42 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 Jul 09 15:30:42 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:43 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25" returned: 0 in 1.131s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:43 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25 Jul 09 15:30:43 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:44 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2.b497f838-445c-47c7-86a6-656889867c25" returned: 0 in 1.281s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-b497f838-445c-47c7-86a6-656889867c25" released by "_delete_snapshot" :: held 4.129s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" released by "delete_snapshot" :: held 4.166s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:45 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Created reservations ['5e7142e2-e8e3-4ccf-b55f-5b7ed76efa6c', '2b477a0a-ad75-49c2-95ce-b09230eee0e3', 'ba6aaea5-e1c3-4139-963a-9fcc8328c330', '7b05446c-d685-40d1-98ff-9b357779ad88'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:30:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Delete snapshot completed successfully. Jul 09 15:30:45 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-476e256a-fdb9-4ae9-9934-b62e2837383c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-b497f838-445c-47c7-86a6-656889867c25-delete_snapshot" released by "delete_snapshot" :: held 4.498s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:46 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" acquired by "delete_volume" :: waited 0.033s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d0d8a6-28cd-41ce-a38d-1770c6b008e2]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:46 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 Jul 09 15:30:46 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:46 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea" returned: 0 in 4.807s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:46 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[5599231f-8742-4d58-9fdf-c90de53e464b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:47 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc Jul 09 15:30:47 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:47 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" returned: 0 in 0.798s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:47 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2 Jul 09 15:30:47 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:47 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:30:47 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:47 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc" returned: 0 in 0.937s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG cinder.image.image_utils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Image conversion details: src /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc, size 1024.00 MB, duration 4.81 sec, destination /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea {{(pid=86916) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 15:30:47 devstack cinder-volume[86916]: INFO cinder.image.image_utils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Converted 1024.00 MB image at 212.97 MB/s Jul 09 15:30:47 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea is being set with open permissions: ugo+rw Jul 09 15:30:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:47 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea Jul 09 15:30:47 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:48 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" returned: 0 in 0.698s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2" released by "delete_volume" :: held 1.605s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Created reservations ['bd078507-cd31-4ce5-8e3f-c4393cc803ba', 'a3c11202-e716-44a6-99ff-ec239da83c98', 'e8e070f7-501e-4d63-acbe-6998c99881f8', '8d9507cb-3416-4cb8-9dbd-69031399037f'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:48 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.662s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:30:48 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:30:48 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:48 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea" returned: 0 in 0.649s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-5799bd3e-ceb9-4786-9183-e0d30824c6ea" released by "_copy_volume_from_snapshot" :: held 8.034s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-fde0221c-24b3-43ef-b0dc-549ee8da353e-5799bd3e-ceb9-4786-9183-e0d30824c6ea" released by "_create_volume_from_snapshot" :: held 8.070s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.096s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c60e755-8b48-4b87-ad03-a362b5b8492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea', 'volume_size': 1, 'snapshot_id': 'fde0221c-24b3-43ef-b0dc-549ee8da353e'}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ab4057-8b29-48df-bf58-8e65cc4192da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:48 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Volume volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea (5799bd3e-ceb9-4786-9183-e0d30824c6ea): created successfully Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ab4057-8b29-48df-bf58-8e65cc4192da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Flow 'volume_create_manager' (4ba91e11-62cd-4786-93a0-de911b36120f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:30:48 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-4c47ac37-fb56-4f5d-8963-8a347790bd3e tempest-SnapshotDependencyTests-1661988039 None] Created volume successfully. Jul 09 15:30:49 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.667s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:30:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Deleted volume successfully. Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-93dbe122-10b8-48be-8f02-ffe22f73e492 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-4cc21ee9-55d2-432e-8bad-b8173ecc0ec2-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (35d174ce-d1a3-41ab-9aef-f257ded3c1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6daa707-1282-4181-8311-6b68ad4deddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6daa707-1282-4181-8311-6b68ad4deddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874869905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1266efaf-2ad7-40fe-b5e3-0b6024af6263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:30:49Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9624dc3-5a51-45c1-8bfe-a17bc4026813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9624dc3-5a51-45c1-8bfe-a17bc4026813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f5330b-4d48-4b40-b73c-0b997ece5375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f5330b-4d48-4b40-b73c-0b997ece5375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1266efaf-2ad7-40fe-b5e3-0b6024af6263', 'volume_name': 'volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fbb97b-92dd-44ce-90b7-c5cf646655ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fbb97b-92dd-44ce-90b7-c5cf646655ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44399666-4268-4561-847e-5ddbe527244e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:49 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Volume 1266efaf-2ad7-40fe-b5e3-0b6024af6263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263', 'volume_size': 1} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874869905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1266efaf-2ad7-40fe-b5e3-0b6024af6263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:30:49Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Creating volume 1266efaf-2ad7-40fe-b5e3-0b6024af6263 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:30:49 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:49 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 1073741824 Jul 09 15:30:49 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "cinder-fde0221c-24b3-43ef-b0dc-549ee8da353e-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-fde0221c-24b3-43ef-b0dc-549ee8da353e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "cinder-quobyte-89f02925-6d36-4558-ae05-e99159acdbfc" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-89f02925-6d36-4558-ae05-e99159acdbfc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "cinder-quobyte-fde0221c-24b3-43ef-b0dc-549ee8da353e" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-fde0221c-24b3-43ef-b0dc-549ee8da353e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Deleting offline snapshot fde0221c-24b3-43ef-b0dc-549ee8da353e of volume 89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] snapshot_file for this snap is: volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ffad33-4858-4468-a9b9-44f1854b6c28]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:49 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e Jul 09 15:30:49 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:50 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 1073741824" returned: 0 in 0.873s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:50 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 Jul 09 15:30:50 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:50 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e" returned: 0 in 0.786s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89f02925-6d36-4558-ae05-e99159acdbfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59f7116-062a-465f-b03b-a20463301397]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:50 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc Jul 09 15:30:50 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:50 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263" returned: 0 in 0.665s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44399666-4268-4561-847e-5ddbe527244e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1582c50-449b-4f80-83d2-2bba31058fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:30:50 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Volume volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 (1266efaf-2ad7-40fe-b5e3-0b6024af6263): created successfully Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1582c50-449b-4f80-83d2-2bba31058fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:30:50 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (35d174ce-d1a3-41ab-9aef-f257ded3c1ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:30:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e57a99d9-915f-47e5-9b31-b1fc996c5bae tempest-ProjectMemberTests-2108537287 None] Created volume successfully. Jul 09 15:30:51 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc" returned: 0 in 0.767s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:51 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e Jul 09 15:30:51 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Creating offline snapshot 5756ea26-e049-4085-8475-1bc26ba73809 of volume 1266efaf-2ad7-40fe-b5e3-0b6024af6263 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:30:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[8869fd9c-c8a1-43f5-9540-10afe0026554]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:51 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 Jul 09 15:30:51 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:51 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e" returned: 0 in 0.722s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:52 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e Jul 09 15:30:52 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:52 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263" returned: 0 in 0.760s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:52 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 1G Jul 09 15:30:52 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:52 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc.fde0221c-24b3-43ef-b0dc-549ee8da353e" returned: 0 in 0.629s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-fde0221c-24b3-43ef-b0dc-549ee8da353e" released by "_delete_snapshot" :: held 3.011s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-89f02925-6d36-4558-ae05-e99159acdbfc" released by "delete_snapshot" :: held 3.032s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:52 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Created reservations ['cd39cb80-8807-48a4-b16f-b8af04c1833c', '3800562f-eac4-4d78-b8c9-c43f1bc202d8', '4ac4f8a2-9e4c-44a2-8396-63086105bf72', 'b1ea29e5-7b51-4e33-be18-9695af09d835'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:30:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Delete snapshot completed successfully. Jul 09 15:30:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-2a3562d0-9435-4b3c-9c10-3f75ae933e31 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-fde0221c-24b3-43ef-b0dc-549ee8da353e-delete_snapshot" released by "delete_snapshot" :: held 3.183s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:53 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 1G" returned: 0 in 0.800s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:53 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 Jul 09 15:30:53 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:53 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809" returned: 0 in 0.657s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:53 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 is being set with open permissions: ugo+rw Jul 09 15:30:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:53 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 Jul 09 15:30:53 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "cinder-89f02925-6d36-4558-ae05-e99159acdbfc-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-89f02925-6d36-4558-ae05-e99159acdbfc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "cinder-quobyte-89f02925-6d36-4558-ae05-e99159acdbfc" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-89f02925-6d36-4558-ae05-e99159acdbfc" acquired by "delete_volume" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:53 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[321ad0ab-814e-4e5d-9996-73e0a5604f58]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:54 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc Jul 09 15:30:54 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:54 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809" returned: 0 in 0.626s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:54 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.info Jul 09 15:30:54 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:54 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc" returned: 0 in 0.742s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:54 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc Jul 09 15:30:54 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:55 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.info" returned: 0 in 0.645s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:55 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.info is being set with open permissions: ugo+rw Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:55 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.info Jul 09 15:30:55 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:55 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-89f02925-6d36-4558-ae05-e99159acdbfc" returned: 0 in 0.643s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-89f02925-6d36-4558-ae05-e99159acdbfc" released by "delete_volume" :: held 1.446s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Created reservations ['4ca62ecc-ed6b-4cc2-b81b-8d13450fa422', '7e4da485-c71d-4eab-9db1-6657caebf0a3', '7b8cb52d-daba-4575-9fb6-346625ba7e09', 'b123747b-22fc-4811-b53b-2fb5b1dcd54c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:55 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:30:55 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:55 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.info" returned: 0 in 0.629s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:55 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cb9a6fa5-2be5-4e3d-8842-f12ed1393d3f tempest-ProjectMemberTests-2108537287 None] Create snapshot completed successfully Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "cinder-5799bd3e-ceb9-4786-9183-e0d30824c6ea-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-5799bd3e-ceb9-4786-9183-e0d30824c6ea-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "cinder-quobyte-5799bd3e-ceb9-4786-9183-e0d30824c6ea" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:56 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.645s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:30:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Deleted volume successfully. Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-5799bd3e-ceb9-4786-9183-e0d30824c6ea" acquired by "delete_volume" :: waited 0.029s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-7e4a212d-f439-40a7-84d2-f9df9bc45333 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-89f02925-6d36-4558-ae05-e99159acdbfc-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3836f420-bc49-4585-bebb-0c39c29577cb]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:56 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea Jul 09 15:30:56 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-5756ea26-e049-4085-8475-1bc26ba73809-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-5756ea26-e049-4085-8475-1bc26ba73809-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-1266efaf-2ad7-40fe-b5e3-0b6024af6263" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-1266efaf-2ad7-40fe-b5e3-0b6024af6263" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-5756ea26-e049-4085-8475-1bc26ba73809" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-5756ea26-e049-4085-8475-1bc26ba73809" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Deleting offline snapshot 5756ea26-e049-4085-8475-1bc26ba73809 of volume 1266efaf-2ad7-40fe-b5e3-0b6024af6263 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] snapshot_file for this snap is: volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e2da81-15e6-4a67-ba50-ea591de62351]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:56 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 Jul 09 15:30:56 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:56 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea" returned: 0 in 0.743s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:56 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea Jul 09 15:30:56 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:57 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-5799bd3e-ceb9-4786-9183-e0d30824c6ea" returned: 0 in 0.646s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:57 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809" returned: 0 in 0.787s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-quobyte-5799bd3e-ceb9-4786-9183-e0d30824c6ea" released by "delete_volume" :: held 1.442s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d37bfd4-9581-4f25-aad5-217152812d32]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Created reservations ['fc76b051-28c8-4e6c-99a6-d884c8e625b5', '3d217721-fe1d-48ac-80d7-5a7000ff6966', '8aa141dd-cc72-43d1-9554-2fc7034eeac4', '9d842acd-4cd9-495e-a0be-96dc8a78ddba'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:30:57 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 Jul 09 15:30:57 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:30:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:57 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:30:57 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:58 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.649s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:58 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:30:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Deleted volume successfully. Jul 09 15:30:58 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13ea181b-fafb-4c20-913a-cad12fb0c744 tempest-SnapshotDependencyTests-1661988039 None] Lock "cinder-5799bd3e-ceb9-4786-9183-e0d30824c6ea-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:58 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263" returned: 0 in 0.818s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:58 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 Jul 09 15:30:58 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:59 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809" returned: 0 in 0.810s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:30:59 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809 Jul 09 15:30:59 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:30:59 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 09 15:30:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263.5756ea26-e049-4085-8475-1bc26ba73809" returned: 0 in 0.686s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:30:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-5756ea26-e049-4085-8475-1bc26ba73809" released by "_delete_snapshot" :: held 3.201s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:30:59 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-1266efaf-2ad7-40fe-b5e3-0b6024af6263" released by "delete_snapshot" :: held 3.230s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:00 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Created reservations ['71388fa7-c047-47d2-b95f-6a1a2b1abea3', '62aa3d16-0972-4ae9-aac3-104547659ece', '6a65960d-6ade-415a-ab73-327a730e060c', '71ce7c20-bd5b-4583-84fc-17915da5c24e'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:31:00 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Delete snapshot completed successfully. Jul 09 15:31:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-41d21552-252e-4218-a2e8-200b0a76b425 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-5756ea26-e049-4085-8475-1bc26ba73809-delete_snapshot" released by "delete_snapshot" :: held 3.377s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-1266efaf-2ad7-40fe-b5e3-0b6024af6263-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Lock "cinder-1266efaf-2ad7-40fe-b5e3-0b6024af6263-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-1266efaf-2ad7-40fe-b5e3-0b6024af6263" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:01 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-1266efaf-2ad7-40fe-b5e3-0b6024af6263" acquired by "delete_volume" :: waited 0.025s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[db258606-e3bf-43fa-8837-ab95b5713d11]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:01 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 Jul 09 15:31:01 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:01 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263" returned: 0 in 0.862s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:02 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263 Jul 09 15:31:02 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:02 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-1266efaf-2ad7-40fe-b5e3-0b6024af6263" returned: 0 in 0.686s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:02 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-1266efaf-2ad7-40fe-b5e3-0b6024af6263" released by "delete_volume" :: held 1.607s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:02 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Created reservations ['fd0d6c87-cf0e-4c0a-bb6e-1f1f32b5297c', 'c6c9c1a4-0b3c-4a5e-bb3a-767a2dc409aa', '766376a2-b0c7-4b78-92f4-0fa0fc8c5331', '12ae5286-36ab-4138-80e0-4e7a32e128cc'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:31:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:02 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:02 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:31:02 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:03 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.721s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:31:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Deleted volume successfully. Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-b9c3eb54-c5a6-4442-bd6b-112531fb211b tempest-ProjectMemberTests-2108537287 None] Lock "cinder-1266efaf-2ad7-40fe-b5e3-0b6024af6263-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (b2a419a0-4619-4bba-b177-7493d39bd4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5f6347-ead9-4b92-9bf6-aa8ee9c94c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5f6347-ead9-4b92-9bf6-aa8ee9c94c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2016040993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc40f31-db49-42db-bfac-b4defa79e1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:31:04Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841361f1-63cf-41b1-ab31-b3421aa311af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841361f1-63cf-41b1-ab31-b3421aa311af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570e8d7b-2d5d-4e0b-bcb5-f8b31616adbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570e8d7b-2d5d-4e0b-bcb5-f8b31616adbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc40f31-db49-42db-bfac-b4defa79e1e5', 'volume_name': 'volume-4fc40f31-db49-42db-bfac-b4defa79e1e5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66469eca-7b3b-4900-8ff2-e00760323f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66469eca-7b3b-4900-8ff2-e00760323f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a5cde4-83a2-4d67-97ad-855014c75bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:03 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Volume 4fc40f31-db49-42db-bfac-b4defa79e1e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc40f31-db49-42db-bfac-b4defa79e1e5', 'volume_size': 1} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2016040993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc40f31-db49-42db-bfac-b4defa79e1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:31:04Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Creating volume 4fc40f31-db49-42db-bfac-b4defa79e1e5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:31:03 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:31:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:03 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 1073741824 Jul 09 15:31:03 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:04 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 1073741824" returned: 0 in 0.951s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:04 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 Jul 09 15:31:04 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:05 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5" returned: 0 in 0.694s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:31:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a5cde4-83a2-4d67-97ad-855014c75bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc40f31-db49-42db-bfac-b4defa79e1e5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa5069d-7c5e-49d1-83ae-7dc048137a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:05 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Volume volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 (4fc40f31-db49-42db-bfac-b4defa79e1e5): created successfully Jul 09 15:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa5069d-7c5e-49d1-83ae-7dc048137a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:05 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (b2a419a0-4619-4bba-b177-7493d39bd4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:31:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-5bb56640-7398-4f7f-b967-bc5d3128fa5d tempest-ProjectMemberTests-2108537287 None] Created volume successfully. Jul 09 15:31:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Creating offline snapshot 775d76aa-7fe1-47e4-b422-c8a7546f9895 of volume 4fc40f31-db49-42db-bfac-b4defa79e1e5 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:31:06 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[014f52b6-6ea8-4953-84bf-e56de7a1bc19]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:06 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 Jul 09 15:31:06 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:06 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5" returned: 0 in 0.826s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:06 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 1G Jul 09 15:31:06 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:07 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 1G" returned: 0 in 0.798s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:07 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 Jul 09 15:31:07 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:08 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895" returned: 0 in 0.689s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:08 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 is being set with open permissions: ugo+rw Jul 09 15:31:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:08 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 Jul 09 15:31:08 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:09 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895" returned: 0 in 0.644s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:09 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.info Jul 09 15:31:09 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:09 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.info" returned: 0 in 0.648s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:09 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.info is being set with open permissions: ugo+rw Jul 09 15:31:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:09 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.info Jul 09 15:31:09 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:10 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.info" returned: 0 in 0.625s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.318s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:10 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-f6283f18-3a11-400f-9c5a-8c133ef84f53 tempest-ProjectMemberTests-2108537287 None] Create snapshot completed successfully Jul 09 15:31:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-775d76aa-7fe1-47e4-b422-c8a7546f9895-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-775d76aa-7fe1-47e4-b422-c8a7546f9895-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-4fc40f31-db49-42db-bfac-b4defa79e1e5" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-4fc40f31-db49-42db-bfac-b4defa79e1e5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-775d76aa-7fe1-47e4-b422-c8a7546f9895" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:11 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-775d76aa-7fe1-47e4-b422-c8a7546f9895" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Deleting offline snapshot 775d76aa-7fe1-47e4-b422-c8a7546f9895 of volume 4fc40f31-db49-42db-bfac-b4defa79e1e5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:31:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] snapshot_file for this snap is: volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:31:11 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bb2ca1-a814-4728-b9ec-92de47e45e9b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:11 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 Jul 09 15:31:11 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:12 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895" returned: 0 in 0.758s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fc40f31-db49-42db-bfac-b4defa79e1e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:31:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd9266f-e9c3-4011-b808-21f5c9611093]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:12 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 Jul 09 15:31:12 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:12 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5" returned: 0 in 0.754s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:12 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 Jul 09 15:31:12 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:13 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895" returned: 0 in 0.704s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:13 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895 Jul 09 15:31:13 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:14 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5.775d76aa-7fe1-47e4-b422-c8a7546f9895" returned: 0 in 0.634s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-775d76aa-7fe1-47e4-b422-c8a7546f9895" released by "_delete_snapshot" :: held 2.933s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-4fc40f31-db49-42db-bfac-b4defa79e1e5" released by "delete_snapshot" :: held 2.955s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=72,cinder:UPDATE=86,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=77,cinder:UPDATE=88,cinder:DELETE=9,cinder:INSERT=24 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Created reservations ['c32d4ddf-f63b-4eda-94cf-bda54632bbcf', '82bddc18-65eb-4e1a-8f57-bf881b0ba3af', '3ec059d1-5d42-41fb-84d8-b9e37fb87545', '99ba7935-ab79-4d0e-a18a-95d24a772896'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:31:14 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Delete snapshot completed successfully. Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-de0b6b1c-4786-494e-9c0e-03607ee34077 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-775d76aa-7fe1-47e4-b422-c8a7546f9895-delete_snapshot" released by "delete_snapshot" :: held 3.098s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-4fc40f31-db49-42db-bfac-b4defa79e1e5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-4fc40f31-db49-42db-bfac-b4defa79e1e5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-4fc40f31-db49-42db-bfac-b4defa79e1e5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-4fc40f31-db49-42db-bfac-b4defa79e1e5" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e867224d-5682-4d67-a6cd-776582df1293]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:14 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 Jul 09 15:31:14 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:15 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5" returned: 0 in 0.772s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:15 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5 Jul 09 15:31:15 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:15 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-4fc40f31-db49-42db-bfac-b4defa79e1e5" returned: 0 in 0.641s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:15 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-4fc40f31-db49-42db-bfac-b4defa79e1e5" released by "delete_volume" :: held 1.470s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Created reservations ['efde5400-85d7-428e-8326-abe6b3fd65e2', '0c8270a2-ada5-4627-ba5f-9ae26a3ad326', '8091d1e8-bdfa-4a58-96b8-f9cdfb9c194f', '5410b284-3c4b-499b-ad47-f112207a06da'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:31:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:16 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:16 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:31:16 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:16 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:16 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:31:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Deleted volume successfully. Jul 09 15:31:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3397257a-68f7-40a7-9fc1-dcafc7d5d119 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-4fc40f31-db49-42db-bfac-b4defa79e1e5-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (a2920d6d-beaf-41cf-a12b-f6020926f408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bceb3fc-2eca-44de-aa81-25cb3b980bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bceb3fc-2eca-44de-aa81-25cb3b980bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564146615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2685ff-5313-4935-9aac-95338b058166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:31:17Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28903242-ce1e-4bee-b1b2-bd4747fd5b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28903242-ce1e-4bee-b1b2-bd4747fd5b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649628b2-4cf9-4a98-b365-948a27af1f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649628b2-4cf9-4a98-b365-948a27af1f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d2685ff-5313-4935-9aac-95338b058166', 'volume_name': 'volume-6d2685ff-5313-4935-9aac-95338b058166', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c80d61e-ed78-4bb6-96ea-7f0551413220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c80d61e-ed78-4bb6-96ea-7f0551413220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f9cdad-4712-4322-aa66-31be8d0f3b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:17 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Volume 6d2685ff-5313-4935-9aac-95338b058166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d2685ff-5313-4935-9aac-95338b058166', 'volume_size': 1} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564146615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2685ff-5313-4935-9aac-95338b058166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:31:17Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Creating volume 6d2685ff-5313-4935-9aac-95338b058166 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:31:17 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:17 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 1073741824 Jul 09 15:31:17 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:17 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 1073741824" returned: 0 in 0.794s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:18 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 Jul 09 15:31:18 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:18 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166" returned: 0 in 0.622s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:31:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f9cdad-4712-4322-aa66-31be8d0f3b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2685ff-5313-4935-9aac-95338b058166', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65daeed0-4660-4236-9a34-b11c1d027096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:18 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Volume volume-6d2685ff-5313-4935-9aac-95338b058166 (6d2685ff-5313-4935-9aac-95338b058166): created successfully Jul 09 15:31:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65daeed0-4660-4236-9a34-b11c1d027096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:18 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (a2920d6d-beaf-41cf-a12b-f6020926f408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:31:18 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-21d76ceb-696a-4c81-910b-8e35b6a6589d tempest-ProjectMemberTests-2108537287 None] Created volume successfully. Jul 09 15:31:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Creating offline snapshot eb9b5990-02e5-4a0d-a460-30999cc938c1 of volume 6d2685ff-5313-4935-9aac-95338b058166 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:31:19 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7791acd-0b3f-429a-ab9b-94c56e48765b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:19 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 Jul 09 15:31:19 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:20 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166" returned: 0 in 0.741s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:20 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 1G Jul 09 15:31:20 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:20 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 1G" returned: 0 in 0.772s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d2685ff-5313-4935-9aac-95338b058166 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:20 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d2685ff-5313-4935-9aac-95338b058166 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 Jul 09 15:31:20 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:21 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d2685ff-5313-4935-9aac-95338b058166 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1" returned: 0 in 0.668s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:21 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 is being set with open permissions: ugo+rw Jul 09 15:31:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:21 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 Jul 09 15:31:21 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:22 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1" returned: 0 in 0.631s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:22 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.info Jul 09 15:31:22 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:22 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.info" returned: 0 in 0.640s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:22 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.info is being set with open permissions: ugo+rw Jul 09 15:31:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:22 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.info Jul 09 15:31:22 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:23 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.info" returned: 0 in 0.641s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.171s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b06df246-7f9c-4c60-85fe-9301b2124a5b tempest-ProjectMemberTests-2108537287 None] Create snapshot completed successfully Jul 09 15:31:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-eb9b5990-02e5-4a0d-a460-30999cc938c1-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-eb9b5990-02e5-4a0d-a460-30999cc938c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-6d2685ff-5313-4935-9aac-95338b058166" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-6d2685ff-5313-4935-9aac-95338b058166" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-eb9b5990-02e5-4a0d-a460-30999cc938c1" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:24 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-eb9b5990-02e5-4a0d-a460-30999cc938c1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Deleting offline snapshot eb9b5990-02e5-4a0d-a460-30999cc938c1 of volume 6d2685ff-5313-4935-9aac-95338b058166 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:31:24 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] snapshot_file for this snap is: volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:31:24 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f44e043-c261-49b0-9752-93abb451f1d2]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:24 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 Jul 09 15:31:24 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:25 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1" returned: 0 in 0.765s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:25 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d2685ff-5313-4935-9aac-95338b058166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:31:25 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[23007053-fae2-42f2-a333-fc0b00e06d81]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:25 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 Jul 09 15:31:25 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:26 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166" returned: 0 in 0.743s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:26 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 Jul 09 15:31:26 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:26 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1" returned: 0 in 0.728s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:26 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1 Jul 09 15:31:26 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:27 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166.eb9b5990-02e5-4a0d-a460-30999cc938c1" returned: 0 in 0.639s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-eb9b5990-02e5-4a0d-a460-30999cc938c1" released by "_delete_snapshot" :: held 2.962s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-6d2685ff-5313-4935-9aac-95338b058166" released by "delete_snapshot" :: held 2.986s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Created reservations ['dd8fc425-a8de-4366-ae67-0cae9f915e56', 'cb6214a2-d6c7-4655-82a3-8a66b666cf71', '9e22ae61-eb1d-4972-be83-d5d9eb9f8f40', '504591af-ed3c-45f1-9955-8dd68b2f2790'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:31:27 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Delete snapshot completed successfully. Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c98e38e6-f53c-43e0-ab08-7b85555c242c tempest-ProjectMemberTests-2108537287 None] Lock "cinder-eb9b5990-02e5-4a0d-a460-30999cc938c1-delete_snapshot" released by "delete_snapshot" :: held 3.122s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-6d2685ff-5313-4935-9aac-95338b058166-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-6d2685ff-5313-4935-9aac-95338b058166-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-6d2685ff-5313-4935-9aac-95338b058166" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-6d2685ff-5313-4935-9aac-95338b058166" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ca4ef7-ff36-47ec-84ba-0c5f7e28f5c8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:27 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 Jul 09 15:31:27 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:28 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166" returned: 0 in 0.739s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:28 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166 Jul 09 15:31:28 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:29 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-6d2685ff-5313-4935-9aac-95338b058166" returned: 0 in 0.641s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-6d2685ff-5313-4935-9aac-95338b058166" released by "delete_volume" :: held 1.431s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Created reservations ['1bdb0e93-9c53-4bef-a56a-018245cb9a4d', '7b908d9a-a688-4ff9-a937-51ebd40cb23f', '36c17541-871a-4ba4-b902-b609242dc658', '22f46961-8cc5-44fa-b919-e96440367963'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:29 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:31:29 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:29 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.653s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:31:29 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Deleted volume successfully. Jul 09 15:31:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-0e1ab568-8565-48d4-a97f-3fc6186253a7 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-6d2685ff-5313-4935-9aac-95338b058166-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (548be90c-2ff4-42a7-bc32-73ea9dbb099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f1d58e-f477-4949-ba29-e70f89910611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f1d58e-f477-4949-ba29-e70f89910611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577982607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fb835f-c874-4e38-837f-557c079f92bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:31:30Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4301dc-47f7-4f70-b2ad-0068910196c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4301dc-47f7-4f70-b2ad-0068910196c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3567ed-c9fe-420e-95ae-707fd1d9a8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3567ed-c9fe-420e-95ae-707fd1d9a8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98fb835f-c874-4e38-837f-557c079f92bf', 'volume_name': 'volume-98fb835f-c874-4e38-837f-557c079f92bf', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b649ff1-cbe8-4e61-a4e7-6374e3c6e485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b649ff1-cbe8-4e61-a4e7-6374e3c6e485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0ad4a4-e2ff-4b1c-afe4-afe976c805a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:30 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Volume 98fb835f-c874-4e38-837f-557c079f92bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98fb835f-c874-4e38-837f-557c079f92bf', 'volume_size': 1} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577982607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fb835f-c874-4e38-837f-557c079f92bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:31:30Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Creating volume 98fb835f-c874-4e38-837f-557c079f92bf {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:31:30 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:31:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:30 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf 1073741824 Jul 09 15:31:30 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:31 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf 1073741824" returned: 0 in 0.802s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:31 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf Jul 09 15:31:31 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:31 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf" returned: 0 in 0.664s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:31:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0ad4a4-e2ff-4b1c-afe4-afe976c805a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98fb835f-c874-4e38-837f-557c079f92bf', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3754707f-b09d-4226-8922-ab4ab22e7656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:31 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Volume volume-98fb835f-c874-4e38-837f-557c079f92bf (98fb835f-c874-4e38-837f-557c079f92bf): created successfully Jul 09 15:31:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3754707f-b09d-4226-8922-ab4ab22e7656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:31 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (548be90c-2ff4-42a7-bc32-73ea9dbb099e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:31:31 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-688727cb-34dd-4165-861c-da3e6595dc5e tempest-ProjectMemberTests-2108537287 None] Created volume successfully. Jul 09 15:31:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:32 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Creating offline snapshot 65166634-343b-4ae8-b98e-866e7643990a of volume 98fb835f-c874-4e38-837f-557c079f92bf {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:31:32 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ea663-0f77-4ba7-bd77-a9e70ae2ef95]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:32 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf Jul 09 15:31:32 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:33 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf" returned: 0 in 0.761s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:33 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:33 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a 1G Jul 09 15:31:33 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:34 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a 1G" returned: 0 in 0.794s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98fb835f-c874-4e38-837f-557c079f92bf -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:34 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98fb835f-c874-4e38-837f-557c079f92bf -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a Jul 09 15:31:34 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:34 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98fb835f-c874-4e38-837f-557c079f92bf -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a" returned: 0 in 0.686s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:34 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a is being set with open permissions: ugo+rw Jul 09 15:31:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:34 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a Jul 09 15:31:34 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:35 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a" returned: 0 in 0.628s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:35 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.info Jul 09 15:31:35 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:36 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.info" returned: 0 in 0.646s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:36 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.info is being set with open permissions: ugo+rw Jul 09 15:31:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:36 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.info Jul 09 15:31:36 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:36 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.info" returned: 0 in 0.638s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.229s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:36 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-2fddbd1f-7a9b-47aa-9287-947971ecec62 tempest-ProjectMemberTests-2108537287 None] Create snapshot completed successfully Jul 09 15:31:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-65166634-343b-4ae8-b98e-866e7643990a-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Lock "cinder-65166634-343b-4ae8-b98e-866e7643990a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-98fb835f-c874-4e38-837f-557c079f92bf" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-98fb835f-c874-4e38-837f-557c079f92bf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-65166634-343b-4ae8-b98e-866e7643990a" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-65166634-343b-4ae8-b98e-866e7643990a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Deleting offline snapshot 65166634-343b-4ae8-b98e-866e7643990a of volume 98fb835f-c874-4e38-837f-557c079f92bf {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:31:37 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] snapshot_file for this snap is: volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:31:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d20f55-0e05-4c7e-8990-1d2d8ea03f9d]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:37 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a Jul 09 15:31:37 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:38 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a" returned: 0 in 0.729s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98fb835f-c874-4e38-837f-557c079f92bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:31:38 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e061f5-dc43-45c4-9cc0-42367ecd6ae6]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:38 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf Jul 09 15:31:38 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:39 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf" returned: 0 in 0.738s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:39 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a Jul 09 15:31:39 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:40 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a" returned: 0 in 0.710s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:40 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a Jul 09 15:31:40 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:40 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf.65166634-343b-4ae8-b98e-866e7643990a" returned: 0 in 0.642s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-65166634-343b-4ae8-b98e-866e7643990a" released by "_delete_snapshot" :: held 2.905s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-98fb835f-c874-4e38-837f-557c079f92bf" released by "delete_snapshot" :: held 2.929s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:40 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Created reservations ['88238c31-43b2-4977-a9ec-a92711f6127b', '90d75055-e827-4944-86fc-511c2b2a074c', 'c36d19b1-f996-4373-a026-32a7287f4c60', '2410113d-a8ca-4142-a74a-a92f4bcc5c7d'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:31:40 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Delete snapshot completed successfully. Jul 09 15:31:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bb2be8bb-0a84-4899-a148-88f23742c4db tempest-ProjectMemberTests-2108537287 None] Lock "cinder-65166634-343b-4ae8-b98e-866e7643990a-delete_snapshot" released by "delete_snapshot" :: held 3.073s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-98fb835f-c874-4e38-837f-557c079f92bf-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:40 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-98fb835f-c874-4e38-837f-557c079f92bf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-98fb835f-c874-4e38-837f-557c079f92bf" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:41 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-98fb835f-c874-4e38-837f-557c079f92bf" acquired by "delete_volume" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:41 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b6cbab-1c72-4623-8b58-70fd92120766]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:41 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf Jul 09 15:31:41 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:41 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf" returned: 0 in 0.774s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:41 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf Jul 09 15:31:41 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:42 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-98fb835f-c874-4e38-837f-557c079f92bf" returned: 0 in 0.629s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:42 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-98fb835f-c874-4e38-837f-557c079f92bf" released by "delete_volume" :: held 1.460s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:42 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Created reservations ['be7be362-3087-43c5-853f-39b3db507bb3', '35a8c8e4-58f3-4ad4-acd7-25f4edef85ca', 'b855ab92-9706-4961-ace7-2a72ad51e714', '5359684b-52a9-4664-9a4f-ae1d4b3307a2'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:31:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:42 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:31:42 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:43 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.651s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:31:43 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Deleted volume successfully. Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-220511fd-feb9-4280-8ade-376ffcd9aa50 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-98fb835f-c874-4e38-837f-557c079f92bf-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (de2d346a-a7e0-421d-b0aa-3c4b4666fc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55be1019-dac6-4689-949c-9c2507086ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55be1019-dac6-4689-949c-9c2507086ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328396426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3430ae2f-bf64-43ac-b268-ef749698d774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:31:44Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1377806-229f-426d-bc99-f4ac0ba7e670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1377806-229f-426d-bc99-f4ac0ba7e670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500f0c25-8f7c-40c7-bb0a-4033f7648e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500f0c25-8f7c-40c7-bb0a-4033f7648e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3430ae2f-bf64-43ac-b268-ef749698d774', 'volume_name': 'volume-3430ae2f-bf64-43ac-b268-ef749698d774', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cf539f-7ef0-45f9-b9a5-c108e4042960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cf539f-7ef0-45f9-b9a5-c108e4042960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cfbf95-e1ed-47ce-be6b-1d07466ac8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:43 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Volume 3430ae2f-bf64-43ac-b268-ef749698d774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3430ae2f-bf64-43ac-b268-ef749698d774', 'volume_size': 1} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328396426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3430ae2f-bf64-43ac-b268-ef749698d774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:31:44Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Creating volume 3430ae2f-bf64-43ac-b268-ef749698d774 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:31:43 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:31:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:43 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 1073741824 Jul 09 15:31:43 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:44 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 1073741824" returned: 0 in 0.795s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:44 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 Jul 09 15:31:44 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:45 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774" returned: 0 in 0.636s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cfbf95-e1ed-47ce-be6b-1d07466ac8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3430ae2f-bf64-43ac-b268-ef749698d774', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663b035e-8eeb-4053-8ece-07746f72af21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:45 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Volume volume-3430ae2f-bf64-43ac-b268-ef749698d774 (3430ae2f-bf64-43ac-b268-ef749698d774): created successfully Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663b035e-8eeb-4053-8ece-07746f72af21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (de2d346a-a7e0-421d-b0aa-3c4b4666fc48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:31:45 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b6319075-f210-49ac-a994-098c99f4d383 tempest-ProjectMemberTests-2108537287 None] Created volume successfully. Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Creating offline snapshot d25b4fee-afe4-4ef8-a394-e9638ee679f3 of volume 3430ae2f-bf64-43ac-b268-ef749698d774 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9699dbd-7f90-4e27-b951-a4f358b82eee]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:45 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 Jul 09 15:31:45 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:46 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774" returned: 0 in 0.740s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:46 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 1G Jul 09 15:31:46 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:47 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 1G" returned: 0 in 0.769s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3430ae2f-bf64-43ac-b268-ef749698d774 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:47 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3430ae2f-bf64-43ac-b268-ef749698d774 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 Jul 09 15:31:47 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:31:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:47 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:31:47 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:48 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3430ae2f-bf64-43ac-b268-ef749698d774 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3" returned: 0 in 0.687s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:48 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 is being set with open permissions: ugo+rw Jul 09 15:31:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:48 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 Jul 09 15:31:48 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:48 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.646s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:31:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:31:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:31:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:31:48 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3" returned: 0 in 0.624s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:48 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.info Jul 09 15:31:48 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:49 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.info" returned: 0 in 0.635s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:49 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.info is being set with open permissions: ugo+rw Jul 09 15:31:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:49 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.info Jul 09 15:31:49 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:49 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.info" returned: 0 in 0.622s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.155s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:49 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-584ec8a5-af6c-4402-96db-cfa69e028c8d tempest-ProjectMemberTests-2108537287 None] Create snapshot completed successfully Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-d25b4fee-afe4-4ef8-a394-e9638ee679f3-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-d25b4fee-afe4-4ef8-a394-e9638ee679f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-3430ae2f-bf64-43ac-b268-ef749698d774" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-3430ae2f-bf64-43ac-b268-ef749698d774" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-d25b4fee-afe4-4ef8-a394-e9638ee679f3" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-d25b4fee-afe4-4ef8-a394-e9638ee679f3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Deleting offline snapshot d25b4fee-afe4-4ef8-a394-e9638ee679f3 of volume 3430ae2f-bf64-43ac-b268-ef749698d774 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] snapshot_file for this snap is: volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aad170b-51ec-4755-a410-c53bb78f724b]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:51 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 Jul 09 15:31:51 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:51 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3" returned: 0 in 0.739s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3430ae2f-bf64-43ac-b268-ef749698d774(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[071ef2c9-1b1c-487b-bf69-5c85f5c3b296]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:51 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 Jul 09 15:31:51 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:52 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774" returned: 0 in 0.743s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:52 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 Jul 09 15:31:52 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:53 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3" returned: 0 in 0.707s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:53 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3 Jul 09 15:31:53 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:53 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774.d25b4fee-afe4-4ef8-a394-e9638ee679f3" returned: 0 in 0.613s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-d25b4fee-afe4-4ef8-a394-e9638ee679f3" released by "_delete_snapshot" :: held 2.892s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:53 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-3430ae2f-bf64-43ac-b268-ef749698d774" released by "delete_snapshot" :: held 2.916s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:54 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Created reservations ['a519e8c9-b49f-43d1-8b6d-e271a1541ce7', '5bc21ccd-41dd-41dc-b62b-23b6de7f3c43', 'dff2f2ed-d26b-4743-ba9c-0bb0c4f4ea02', 'b4cf1f94-2d6b-4edd-a8c1-b9fa95711004'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:31:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Delete snapshot completed successfully. Jul 09 15:31:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-37c1d03f-5e57-4683-89e7-3f4aab8947b9 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-d25b4fee-afe4-4ef8-a394-e9638ee679f3-delete_snapshot" released by "delete_snapshot" :: held 3.090s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-3430ae2f-bf64-43ac-b268-ef749698d774-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Lock "cinder-3430ae2f-bf64-43ac-b268-ef749698d774-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-3430ae2f-bf64-43ac-b268-ef749698d774" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:31:54 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-3430ae2f-bf64-43ac-b268-ef749698d774" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:31:54 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9044336c-e38f-464d-adcc-c2e02a122f01]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:54 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 Jul 09 15:31:54 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:55 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774" returned: 0 in 0.774s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:55 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774 Jul 09 15:31:55 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:55 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3430ae2f-bf64-43ac-b268-ef749698d774" returned: 0 in 0.651s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-3430ae2f-bf64-43ac-b268-ef749698d774" released by "delete_volume" :: held 1.481s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Created reservations ['e003554f-71a6-4a4e-8c31-a2f5c65e5527', 'a24b3443-5463-4682-a25c-9dbd75fe4f00', 'e690eb88-f07d-4b38-82f1-c0c8a79b7281', 'd3b9ecf7-28b3-4038-985c-d02d080a5b00'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:55 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:31:55 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:56 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.642s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:31:56 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Deleted volume successfully. Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-bd25cddc-2f1c-4994-8bb0-567c40134a9e tempest-ProjectMemberTests-2108537287 None] Lock "cinder-3430ae2f-bf64-43ac-b268-ef749698d774-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (ed2e85b6-db52-488e-93ed-b032a2c06533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b73e80e-d8db-4255-9038-12382f27bdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b73e80e-d8db-4255-9038-12382f27bdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437304780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc87de5-0676-4c04-8486-f681ae04ac30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:31:57Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4ea0c5-f6cc-498f-9b9c-17a8ad964bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4ea0c5-f6cc-498f-9b9c-17a8ad964bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4d3359-bd81-45fb-908e-327ed80afb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4d3359-bd81-45fb-908e-327ed80afb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc87de5-0676-4c04-8486-f681ae04ac30', 'volume_name': 'volume-fbc87de5-0676-4c04-8486-f681ae04ac30', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b63d2b9-67f7-45ce-8205-d64cf98c37cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b63d2b9-67f7-45ce-8205-d64cf98c37cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18dc0f38-6598-4dae-afd8-d776ec8c38f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:56 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Volume fbc87de5-0676-4c04-8486-f681ae04ac30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc87de5-0676-4c04-8486-f681ae04ac30', 'volume_size': 1} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437304780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc87de5-0676-4c04-8486-f681ae04ac30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:31:57Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Creating volume fbc87de5-0676-4c04-8486-f681ae04ac30 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:31:56 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:31:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:56 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 1073741824 Jul 09 15:31:56 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:57 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 1073741824" returned: 0 in 0.793s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:57 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 Jul 09 15:31:57 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:58 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30" returned: 0 in 0.619s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:58 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:31:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:31:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18dc0f38-6598-4dae-afd8-d776ec8c38f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc87de5-0676-4c04-8486-f681ae04ac30', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbf050b-331d-4f31-99ad-6c1c2cb9cd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:31:58 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Volume volume-fbc87de5-0676-4c04-8486-f681ae04ac30 (fbc87de5-0676-4c04-8486-f681ae04ac30): created successfully Jul 09 15:31:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbf050b-331d-4f31-99ad-6c1c2cb9cd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:31:58 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (ed2e85b6-db52-488e-93ed-b032a2c06533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:31:58 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ef714f0c-79c8-475a-a942-2d9c739fcd5d tempest-ProjectMemberTests-2108537287 None] Created volume successfully. Jul 09 15:31:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:31:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:31:59 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Creating offline snapshot 36702cc4-db0e-4138-b6fb-52e0383fa19f of volume fbc87de5-0676-4c04-8486-f681ae04ac30 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:31:59 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c960daf-4310-44b2-a9e6-14c6a07961c5]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:31:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:59 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 Jul 09 15:31:59 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:31:59 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 09 15:31:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30" returned: 0 in 0.751s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:31:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:31:59 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f 1G Jul 09 15:31:59 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:00 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f 1G" returned: 0 in 0.774s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc87de5-0676-4c04-8486-f681ae04ac30 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:00 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc87de5-0676-4c04-8486-f681ae04ac30 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f Jul 09 15:32:00 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:01 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc87de5-0676-4c04-8486-f681ae04ac30 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f" returned: 0 in 0.665s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:01 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f is being set with open permissions: ugo+rw Jul 09 15:32:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:01 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f Jul 09 15:32:01 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:01 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f" returned: 0 in 0.647s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:01 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.info Jul 09 15:32:01 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:02 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.info" returned: 0 in 0.645s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:02 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.info is being set with open permissions: ugo+rw Jul 09 15:32:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:02 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.info Jul 09 15:32:02 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:03 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.info" returned: 0 in 0.637s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.199s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-7ab553ec-5cbf-4fef-9436-19830cd0e796 tempest-ProjectMemberTests-2108537287 None] Create snapshot completed successfully Jul 09 15:32:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-36702cc4-db0e-4138-b6fb-52e0383fa19f-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Lock "cinder-36702cc4-db0e-4138-b6fb-52e0383fa19f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-fbc87de5-0676-4c04-8486-f681ae04ac30" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-fbc87de5-0676-4c04-8486-f681ae04ac30" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-36702cc4-db0e-4138-b6fb-52e0383fa19f" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:04 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-36702cc4-db0e-4138-b6fb-52e0383fa19f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Deleting offline snapshot 36702cc4-db0e-4138-b6fb-52e0383fa19f of volume fbc87de5-0676-4c04-8486-f681ae04ac30 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:32:04 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] snapshot_file for this snap is: volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:32:04 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef09de3-3c9e-40c0-9985-bfd8ff4be1c2]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:04 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f Jul 09 15:32:04 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:05 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f" returned: 0 in 0.757s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbc87de5-0676-4c04-8486-f681ae04ac30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:32:05 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[803fd394-f37a-47bb-a0e8-af6cc6d5433f]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:05 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 Jul 09 15:32:05 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:05 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30" returned: 0 in 0.755s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:05 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f Jul 09 15:32:05 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:06 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f" returned: 0 in 0.721s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:06 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f Jul 09 15:32:06 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:07 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30.36702cc4-db0e-4138-b6fb-52e0383fa19f" returned: 0 in 0.638s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-36702cc4-db0e-4138-b6fb-52e0383fa19f" released by "_delete_snapshot" :: held 2.952s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-fbc87de5-0676-4c04-8486-f681ae04ac30" released by "delete_snapshot" :: held 2.972s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Created reservations ['08fe2e79-d750-4bee-8ea1-970c4d9fc3e6', 'a291d81d-fda9-4426-bcf1-0409afb56b94', '260ac6e1-9e18-486a-98ce-640586defa99', '1b523bac-34b0-42bc-b3c8-2bd92ccb2944'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:32:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Delete snapshot completed successfully. Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-e20f94d1-33d1-422c-af27-50089feb62de tempest-ProjectMemberTests-2108537287 None] Lock "cinder-36702cc4-db0e-4138-b6fb-52e0383fa19f-delete_snapshot" released by "delete_snapshot" :: held 3.109s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-fbc87de5-0676-4c04-8486-f681ae04ac30-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Lock "cinder-fbc87de5-0676-4c04-8486-f681ae04ac30-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-fbc87de5-0676-4c04-8486-f681ae04ac30" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-fbc87de5-0676-4c04-8486-f681ae04ac30" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0db06e-b2f3-4c53-ae12-d546739aae51]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:07 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 Jul 09 15:32:07 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:08 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30" returned: 0 in 0.756s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:08 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30 Jul 09 15:32:08 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:09 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-fbc87de5-0676-4c04-8486-f681ae04ac30" returned: 0 in 0.666s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-fbc87de5-0676-4c04-8486-f681ae04ac30" released by "delete_volume" :: held 1.493s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Created reservations ['a069024c-14fb-44e5-9619-a3da405e8899', 'adbd84ca-875b-4cda-a577-121b23be4ef1', '3c589223-681d-41ea-9247-74f4fe667fd7', '723f9d2f-f66c-44bf-ab14-e2053f16eac3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:09 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:32:09 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:09 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.631s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:32:09 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Deleted volume successfully. Jul 09 15:32:09 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-aa8446a8-c040-432b-bc91-ee731b72b5cd tempest-ProjectMemberTests-2108537287 None] Lock "cinder-fbc87de5-0676-4c04-8486-f681ae04ac30-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (9fc98c14-a824-42da-a472-71d2fcc8edb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02800c3f-e7a1-464e-8ca4-41f0ccb24ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02800c3f-e7a1-464e-8ca4-41f0ccb24ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1574238259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4ade9c-6097-474f-ab6b-fdf591dd3c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:32:10Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2114673-2243-4dac-96aa-f16c5d73915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2114673-2243-4dac-96aa-f16c5d73915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb5ffe0-4399-41d1-a877-003efe13c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb5ffe0-4399-41d1-a877-003efe13c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4ade9c-6097-474f-ab6b-fdf591dd3c4f', 'volume_name': 'volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdc3e32-ba84-4932-a744-9b1dea4f95db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdc3e32-ba84-4932-a744-9b1dea4f95db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319f1ac0-5014-404f-9ece-200206d9387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:10 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Volume ec4ade9c-6097-474f-ab6b-fdf591dd3c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f', 'volume_size': 1} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1574238259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4ade9c-6097-474f-ab6b-fdf591dd3c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca85ec6124e24671bd2ffa6e6cbb0b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:32:10Z,use_quota=True,user_id='757f884cc32d4bbfa800b6963af40583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Creating volume ec4ade9c-6097-474f-ab6b-fdf591dd3c4f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:32:10 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:10 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f 1073741824 Jul 09 15:32:10 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:10 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f 1073741824" returned: 0 in 0.791s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:11 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f Jul 09 15:32:11 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:11 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" returned: 0 in 0.631s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:11 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:32:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319f1ac0-5014-404f-9ece-200206d9387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2231430-db06-484b-b8be-bb4e3636bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:11 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Volume volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f (ec4ade9c-6097-474f-ab6b-fdf591dd3c4f): created successfully Jul 09 15:32:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2231430-db06-484b-b8be-bb4e3636bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:11 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Flow 'volume_create_manager' (9fc98c14-a824-42da-a472-71d2fcc8edb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:32:11 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-e016a70e-e2d9-4479-9531-b986bd0a7cdf tempest-ProjectMemberTests-2108537287 None] Created volume successfully. Jul 09 15:32:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:12 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Creating offline snapshot 3016d395-4a75-4fdf-99b0-99fdfd639ada of volume ec4ade9c-6097-474f-ab6b-fdf591dd3c4f {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:32:12 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2b25ef-b6e5-45b8-afbb-31bd724997d8]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:12 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f Jul 09 15:32:12 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:13 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" returned: 0 in 0.819s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:13 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada 1G Jul 09 15:32:13 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:13 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada 1G" returned: 0 in 0.779s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:13 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada Jul 09 15:32:13 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:14 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada" returned: 0 in 0.674s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:14 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada is being set with open permissions: ugo+rw Jul 09 15:32:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:14 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada Jul 09 15:32:14 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:15 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada" returned: 0 in 0.628s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:15 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=69,cinder:INSERT=23,cinder:UPDATE=86,cinder:DELETE=6 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:32:15 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:INSERT=26,cinder:UPDATE=93,cinder:SELECT=67,cinder:DELETE=8 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:32:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:15 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.info Jul 09 15:32:15 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:15 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.info" returned: 0 in 0.647s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:15 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.info is being set with open permissions: ugo+rw Jul 09 15:32:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:15 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.info Jul 09 15:32:15 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:16 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.info" returned: 0 in 0.631s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.258s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-b8725a13-e187-4c78-b41c-b063eb3ff330 tempest-ProjectMemberTests-2108537287 None] Create snapshot completed successfully Jul 09 15:32:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-3016d395-4a75-4fdf-99b0-99fdfd639ada-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-3016d395-4a75-4fdf-99b0-99fdfd639ada-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-3016d395-4a75-4fdf-99b0-99fdfd639ada" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:17 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-3016d395-4a75-4fdf-99b0-99fdfd639ada" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Deleting offline snapshot 3016d395-4a75-4fdf-99b0-99fdfd639ada of volume ec4ade9c-6097-474f-ab6b-fdf591dd3c4f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:32:17 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] snapshot_file for this snap is: volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:32:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[391ab2b3-66e5-4683-aca8-d81ea4449c83]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:17 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada Jul 09 15:32:17 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:18 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada" returned: 0 in 0.733s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:32:18 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6323f115-f4c9-4c92-b4ca-e9b020881822]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:18 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f Jul 09 15:32:18 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:19 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" returned: 0 in 0.729s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:19 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada Jul 09 15:32:19 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:19 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada" returned: 0 in 0.714s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:19 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada Jul 09 15:32:19 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:20 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f.3016d395-4a75-4fdf-99b0-99fdfd639ada" returned: 0 in 0.622s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-3016d395-4a75-4fdf-99b0-99fdfd639ada" released by "_delete_snapshot" :: held 2.884s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" released by "delete_snapshot" :: held 2.904s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Created reservations ['3851d900-a16e-4568-95c0-d0547a0761f8', '052851f8-7290-4561-a8c4-43a9ecc90399', 'd8f5b1c9-ab44-408f-bf3a-a3e968f16591', 'b0b2f90e-26b2-407b-8de6-7f5d88675f4a'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:32:20 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Delete snapshot completed successfully. Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-24020ae7-aaab-4c1b-9753-2870c5424095 tempest-ProjectMemberTests-2108537287 None] Lock "cinder-3016d395-4a75-4fdf-99b0-99fdfd639ada-delete_snapshot" released by "delete_snapshot" :: held 3.027s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Lock "cinder-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "cinder-quobyte-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" acquired by "delete_volume" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[31422269-aa9a-42c9-ba15-0603a6252dfe]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:21 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f Jul 09 15:32:21 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:21 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" returned: 0 in 0.730s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:21 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f Jul 09 15:32:21 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:22 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" returned: 0 in 0.627s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Lock "cinder-quobyte-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f" released by "delete_volume" :: held 1.414s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Created reservations ['9b05ba93-25e7-4b8c-af2f-6c030ba96996', '60f08d2d-63a7-415e-89a9-29823453e63f', '38b80d12-cf16-4b93-8075-b9378777d037', 'ff65081f-1d07-493a-b948-79f38d19422c'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:22 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:32:22 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:22 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.621s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:22 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:32:23 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Deleted volume successfully. Jul 09 15:32:23 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-a063ec39-3b90-4d92-8147-435ff5e80d1d tempest-ProjectMemberTests-2108537287 None] Lock "cinder-ec4ade9c-6097-474f-ab6b-fdf591dd3c4f-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Flow 'volume_create_manager' (252dd528-73bf-4342-b298-086eebed4bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb772cd-fa26-4c9a-ae74-e3afb2b8474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb772cd-fa26-4c9a-ae74-e3afb2b8474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1120504014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd419d0-b446-4a9b-aa99-57c750c5e72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfad9b77c26748c88338034e79c39e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:32:26Z,use_quota=True,user_id='9317d8e53e4944a9839d2e079dce94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed96c298-0d40-4d85-8bff-596d798db2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed96c298-0d40-4d85-8bff-596d798db2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21678c86-4fe1-48f5-b5c2-b3fc3a3edb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21678c86-4fe1-48f5-b5c2-b3fc3a3edb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd419d0-b446-4a9b-aa99-57c750c5e72f', 'volume_name': 'volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7a5d04-af9a-4cda-8cb4-f54d8bf7307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7a5d04-af9a-4cda-8cb4-f54d8bf7307d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674c27ba-f3c9-4220-84b0-141659aca958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:26 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Volume 8dd419d0-b446-4a9b-aa99-57c750c5e72f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f', 'volume_size': 1} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1120504014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd419d0-b446-4a9b-aa99-57c750c5e72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfad9b77c26748c88338034e79c39e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:32:26Z,use_quota=True,user_id='9317d8e53e4944a9839d2e079dce94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Creating volume 8dd419d0-b446-4a9b-aa99-57c750c5e72f {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:32:26 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:32:26 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:26 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f 1073741824 Jul 09 15:32:26 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:27 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f 1073741824" returned: 0 in 0.789s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:27 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f Jul 09 15:32:27 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:27 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f" returned: 0 in 0.631s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:32:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674c27ba-f3c9-4220-84b0-141659aca958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7a6a02-ab78-439e-806f-c011a633ebc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:28 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Volume volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f (8dd419d0-b446-4a9b-aa99-57c750c5e72f): created successfully Jul 09 15:32:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7a6a02-ab78-439e-806f-c011a633ebc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:28 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Flow 'volume_create_manager' (252dd528-73bf-4342-b298-086eebed4bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:32:28 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-374ae7a6-3156-492d-8eb9-549753e07fc8 tempest-ProjectReaderTests-1048148721 None] Created volume successfully. Jul 09 15:32:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:28 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Creating offline snapshot 148ad828-a1f4-4298-8faf-f1a8f9e38f5b of volume 8dd419d0-b446-4a9b-aa99-57c750c5e72f {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:32:28 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9dea0f-a044-43b7-a6cd-1566d92bfcdb]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:28 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f Jul 09 15:32:28 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:29 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f" returned: 0 in 0.752s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:29 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b 1G Jul 09 15:32:29 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:30 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b 1G" returned: 0 in 0.767s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:30 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b Jul 09 15:32:30 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:30 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b" returned: 0 in 0.674s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:30 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b is being set with open permissions: ugo+rw Jul 09 15:32:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:30 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b Jul 09 15:32:30 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:31 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b" returned: 0 in 0.693s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:31 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.info Jul 09 15:32:31 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:32 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.info" returned: 0 in 0.668s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:32 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.info is being set with open permissions: ugo+rw Jul 09 15:32:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:32 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.info Jul 09 15:32:32 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:32 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.info" returned: 0 in 0.645s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.276s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-849ff65a-0b33-4456-9b10-da2fb1fc8dbe tempest-ProjectReaderTests-1048148721 None] Create snapshot completed successfully Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-148ad828-a1f4-4298-8faf-f1a8f9e38f5b-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-148ad828-a1f4-4298-8faf-f1a8f9e38f5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-8dd419d0-b446-4a9b-aa99-57c750c5e72f" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-8dd419d0-b446-4a9b-aa99-57c750c5e72f" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-148ad828-a1f4-4298-8faf-f1a8f9e38f5b" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-148ad828-a1f4-4298-8faf-f1a8f9e38f5b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Deleting offline snapshot 148ad828-a1f4-4298-8faf-f1a8f9e38f5b of volume 8dd419d0-b446-4a9b-aa99-57c750c5e72f {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] snapshot_file for this snap is: volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1842fa-9d65-440c-a9fd-f1b437a96506]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:34 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b Jul 09 15:32:34 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:34 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b" returned: 0 in 0.738s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99636d7-2252-438c-a1fd-80cf0465e28c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:34 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:34 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f Jul 09 15:32:34 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:35 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f" returned: 0 in 0.743s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:35 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:35 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b Jul 09 15:32:35 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:36 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b" returned: 0 in 0.715s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:36 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b Jul 09 15:32:36 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:36 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:36 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f.148ad828-a1f4-4298-8faf-f1a8f9e38f5b" returned: 0 in 0.620s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-148ad828-a1f4-4298-8faf-f1a8f9e38f5b" released by "_delete_snapshot" :: held 2.904s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:36 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-8dd419d0-b446-4a9b-aa99-57c750c5e72f" released by "delete_snapshot" :: held 2.923s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:37 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Created reservations ['8a9fc3b0-ddbb-4d17-929b-4af6a4b0bb3d', 'f009e60e-62aa-459e-a576-8d3db2c302da', '56bfd181-20d7-4ada-bffe-cd0114d5986e', '4b6b80c1-a9cb-4ae2-a0ef-2959d444d486'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:32:37 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Delete snapshot completed successfully. Jul 09 15:32:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-d7823e5e-7d8f-40a1-af90-cd77e983b388 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-148ad828-a1f4-4298-8faf-f1a8f9e38f5b-delete_snapshot" released by "delete_snapshot" :: held 3.045s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-8dd419d0-b446-4a9b-aa99-57c750c5e72f-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Lock "cinder-8dd419d0-b446-4a9b-aa99-57c750c5e72f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-8dd419d0-b446-4a9b-aa99-57c750c5e72f" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:37 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-8dd419d0-b446-4a9b-aa99-57c750c5e72f" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:37 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[752be6e9-c0c3-4435-80f6-10c1bbb4f717]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:37 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:37 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f Jul 09 15:32:37 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:38 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f" returned: 0 in 0.762s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:38 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f Jul 09 15:32:38 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:38 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-8dd419d0-b446-4a9b-aa99-57c750c5e72f" returned: 0 in 0.651s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-8dd419d0-b446-4a9b-aa99-57c750c5e72f" released by "delete_volume" :: held 1.466s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Created reservations ['88096c87-17f5-4353-a17e-2c43c4f65d62', '71e8a0e3-aa55-47ab-816a-19aa1e774ecc', 'ebf89b36-bb2a-4db7-b22d-d1130dce919c', 'b7972b6f-9afe-4ca3-8245-0a0fe4115325'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:38 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:38 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:32:38 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:39 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.633s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:32:39 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Deleted volume successfully. Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-231dadf2-ef4a-40a0-ad49-acfa745a3f6d tempest-ProjectReaderTests-1048148721 None] Lock "cinder-8dd419d0-b446-4a9b-aa99-57c750c5e72f-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Flow 'volume_create_manager' (911d0e27-aec5-42ea-9cb7-3a9ac1e117a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c4ce39-fb84-43e8-b4fb-792653c6382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c4ce39-fb84-43e8-b4fb-792653c6382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1080923797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd7aa29-e816-42ac-9551-ef26ad0247a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfad9b77c26748c88338034e79c39e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:32:40Z,use_quota=True,user_id='9317d8e53e4944a9839d2e079dce94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50adad6-cbac-43e9-8d38-9565d30e56fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50adad6-cbac-43e9-8d38-9565d30e56fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db11a6e-f78c-4e5e-9eb8-74a266fb8d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db11a6e-f78c-4e5e-9eb8-74a266fb8d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd7aa29-e816-42ac-9551-ef26ad0247a6', 'volume_name': 'volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a47aa17-fe20-458e-a4d9-0ebd16f90de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a47aa17-fe20-458e-a4d9-0ebd16f90de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2642fe-9f6b-46ec-8ab2-aa3ff6ac40a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:39 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Volume cbd7aa29-e816-42ac-9551-ef26ad0247a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6', 'volume_size': 1} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1080923797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd7aa29-e816-42ac-9551-ef26ad0247a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfad9b77c26748c88338034e79c39e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:32:40Z,use_quota=True,user_id='9317d8e53e4944a9839d2e079dce94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Creating volume cbd7aa29-e816-42ac-9551-ef26ad0247a6 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:32:39 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:32:39 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:39 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 1073741824 Jul 09 15:32:39 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:40 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 1073741824" returned: 0 in 0.764s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:40 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:40 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 Jul 09 15:32:40 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:41 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6" returned: 0 in 0.649s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:41 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:32:41 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2642fe-9f6b-46ec-8ab2-aa3ff6ac40a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628145c2-d4b4-46b9-b7dd-f03213709e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:41 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Volume volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 (cbd7aa29-e816-42ac-9551-ef26ad0247a6): created successfully Jul 09 15:32:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628145c2-d4b4-46b9-b7dd-f03213709e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:41 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Flow 'volume_create_manager' (911d0e27-aec5-42ea-9cb7-3a9ac1e117a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:32:41 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-cd2895f2-f74f-4e44-bdc1-f209f9f94c59 tempest-ProjectReaderTests-1048148721 None] Created volume successfully. Jul 09 15:32:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:42 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Creating offline snapshot e1670282-da8c-4606-a944-bb0d80d20690 of volume cbd7aa29-e816-42ac-9551-ef26ad0247a6 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:32:42 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4f4ebe-c9f2-4b4f-8ba8-65251da4a9c4]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:42 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 Jul 09 15:32:42 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:42 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6" returned: 0 in 0.743s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:42 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:42 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 1G Jul 09 15:32:42 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:43 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 1G" returned: 0 in 0.762s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:43 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:43 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 Jul 09 15:32:43 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:44 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690" returned: 0 in 0.663s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:44 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 is being set with open permissions: ugo+rw Jul 09 15:32:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:44 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 Jul 09 15:32:44 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:44 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690" returned: 0 in 0.619s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:44 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:44 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.info Jul 09 15:32:44 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:45 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.info" returned: 0 in 0.642s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:45 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.info is being set with open permissions: ugo+rw Jul 09 15:32:45 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:45 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.info Jul 09 15:32:45 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:46 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.info" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:46 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.140s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:46 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-177274af-a7cb-4923-b140-687bf77bcfec tempest-ProjectReaderTests-1048148721 None] Create snapshot completed successfully Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-e1670282-da8c-4606-a944-bb0d80d20690-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-e1670282-da8c-4606-a944-bb0d80d20690-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-cbd7aa29-e816-42ac-9551-ef26ad0247a6" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-cbd7aa29-e816-42ac-9551-ef26ad0247a6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-e1670282-da8c-4606-a944-bb0d80d20690" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-e1670282-da8c-4606-a944-bb0d80d20690" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Deleting offline snapshot e1670282-da8c-4606-a944-bb0d80d20690 of volume cbd7aa29-e816-42ac-9551-ef26ad0247a6 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] snapshot_file for this snap is: volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2e3f5e-367e-47c2-a4ff-657d6b4ffed4]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:47 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 Jul 09 15:32:47 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:47 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:32:47 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:48 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690" returned: 0 in 0.750s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[756a68a3-7021-4165-a811-f2d16bfe37d1]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:48 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 Jul 09 15:32:48 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:48 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.645s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 15:32:48 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6" returned: 0 in 0.759s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:48 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 Jul 09 15:32:48 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:49 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690" returned: 0 in 0.705s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:49 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:49 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690 Jul 09 15:32:49 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:50 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6.e1670282-da8c-4606-a944-bb0d80d20690" returned: 0 in 0.628s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-e1670282-da8c-4606-a944-bb0d80d20690" released by "_delete_snapshot" :: held 2.924s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-cbd7aa29-e816-42ac-9551-ef26ad0247a6" released by "delete_snapshot" :: held 2.948s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Created reservations ['ac8383a2-0a6e-41c6-a689-9e2c4cbd4150', '3c0413cf-4200-49e0-a357-96097be9ca4c', 'e563ff83-01e0-4a91-b948-fb760fa1a01a', 'a16d29c9-39c0-4de7-aed9-242776f2cf2b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:32:50 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Delete snapshot completed successfully. Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-9be3afd9-eeac-43b4-9d3b-8ed6b8c3f6e6 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-e1670282-da8c-4606-a944-bb0d80d20690-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-cbd7aa29-e816-42ac-9551-ef26ad0247a6-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-cbd7aa29-e816-42ac-9551-ef26ad0247a6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-cbd7aa29-e816-42ac-9551-ef26ad0247a6" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-cbd7aa29-e816-42ac-9551-ef26ad0247a6" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bce51a-d287-4d37-9f44-b6a0742add0e]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:50 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:50 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 Jul 09 15:32:50 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:51 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6" returned: 0 in 0.737s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:51 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6 Jul 09 15:32:51 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:51 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:51 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cbd7aa29-e816-42ac-9551-ef26ad0247a6" returned: 0 in 0.628s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:51 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-cbd7aa29-e816-42ac-9551-ef26ad0247a6" released by "delete_volume" :: held 1.417s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:51 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Created reservations ['51bd37f3-ae06-4c5d-8fe9-dc0bc85ba790', '8d70e812-6d4a-4bdc-b30c-a3bd2c3bf12d', '5fe4351e-4d1f-43ed-acb0-9939179867aa', 'af3a8980-3652-405d-853c-bbdc03ec916b'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:32:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:32:52 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:32:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:52 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:32:52 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:52 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:52 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.629s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:52 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:32:52 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Deleted volume successfully. Jul 09 15:32:52 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-34a7c797-46bd-49c9-b23d-c51a701d5e14 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-cbd7aa29-e816-42ac-9551-ef26ad0247a6-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Flow 'volume_create_manager' (459a4285-4e13-4da4-8fe0-57f95520b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e824c9d4-9e68-400c-81c6-57fb4e0702a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e824c9d4-9e68-400c-81c6-57fb4e0702a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776025032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d96da8a-9069-441e-a6da-078ea9661a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfad9b77c26748c88338034e79c39e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:32:53Z,use_quota=True,user_id='9317d8e53e4944a9839d2e079dce94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf51b8f0-c22a-4d14-8a46-0a4b47d3b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf51b8f0-c22a-4d14-8a46-0a4b47d3b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e197e9-ce8d-4dee-9208-a5c06a519ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e197e9-ce8d-4dee-9208-a5c06a519ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d96da8a-9069-441e-a6da-078ea9661a67', 'volume_name': 'volume-3d96da8a-9069-441e-a6da-078ea9661a67', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f45ce5-940a-4ded-9fb3-b397bed9a91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f45ce5-940a-4ded-9fb3-b397bed9a91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17745a3-4d03-4892-82db-528939e7e6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:53 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Volume 3d96da8a-9069-441e-a6da-078ea9661a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d96da8a-9069-441e-a6da-078ea9661a67', 'volume_size': 1} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776025032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d96da8a-9069-441e-a6da-078ea9661a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfad9b77c26748c88338034e79c39e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:32:53Z,use_quota=True,user_id='9317d8e53e4944a9839d2e079dce94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Creating volume 3d96da8a-9069-441e-a6da-078ea9661a67 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:32:53 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:53 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 1073741824 Jul 09 15:32:53 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:53 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 1073741824" returned: 0 in 0.786s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:53 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:54 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 Jul 09 15:32:54 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:54 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67" returned: 0 in 0.636s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:32:54 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17745a3-4d03-4892-82db-528939e7e6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d96da8a-9069-441e-a6da-078ea9661a67', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf31aa1-90f0-40ba-879e-dd6f3c922f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:32:54 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Volume volume-3d96da8a-9069-441e-a6da-078ea9661a67 (3d96da8a-9069-441e-a6da-078ea9661a67): created successfully Jul 09 15:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf31aa1-90f0-40ba-879e-dd6f3c922f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:32:54 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Flow 'volume_create_manager' (459a4285-4e13-4da4-8fe0-57f95520b14a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:32:54 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-076c6a3e-4c4f-4790-9deb-997509fc37c1 tempest-ProjectReaderTests-1048148721 None] Created volume successfully. Jul 09 15:32:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:32:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:32:55 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Creating offline snapshot ec4d6549-b225-4e8d-8b12-42b878cd5c59 of volume 3d96da8a-9069-441e-a6da-078ea9661a67 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:32:55 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee10e18c-5e63-4542-953b-8334c6368f64]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:32:55 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:55 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 Jul 09 15:32:55 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:56 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67" returned: 0 in 0.745s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:56 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 1G Jul 09 15:32:56 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:56 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 1G" returned: 0 in 0.765s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:56 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d96da8a-9069-441e-a6da-078ea9661a67 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:56 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d96da8a-9069-441e-a6da-078ea9661a67 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 Jul 09 15:32:56 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:57 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d96da8a-9069-441e-a6da-078ea9661a67 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59" returned: 0 in 0.688s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:57 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 is being set with open permissions: ugo+rw Jul 09 15:32:57 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:57 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 Jul 09 15:32:57 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:58 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59" returned: 0 in 0.637s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:58 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.info Jul 09 15:32:58 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:58 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.info" returned: 0 in 0.627s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:58 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.info is being set with open permissions: ugo+rw Jul 09 15:32:58 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:32:58 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.info Jul 09 15:32:58 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:32:59 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 09 15:32:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.info" returned: 0 in 0.636s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:32:59 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.172s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:32:59 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-068286bc-ba01-471c-bb3e-9dd3a1b57f34 tempest-ProjectReaderTests-1048148721 None] Create snapshot completed successfully Jul 09 15:33:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-ec4d6549-b225-4e8d-8b12-42b878cd5c59-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Lock "cinder-ec4d6549-b225-4e8d-8b12-42b878cd5c59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-3d96da8a-9069-441e-a6da-078ea9661a67" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-3d96da8a-9069-441e-a6da-078ea9661a67" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-ec4d6549-b225-4e8d-8b12-42b878cd5c59" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:00 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-ec4d6549-b225-4e8d-8b12-42b878cd5c59" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Deleting offline snapshot ec4d6549-b225-4e8d-8b12-42b878cd5c59 of volume 3d96da8a-9069-441e-a6da-078ea9661a67 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:33:00 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] snapshot_file for this snap is: volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:33:00 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ebb2b8-97aa-48ba-8ec8-8bf4b7cff7cc]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:00 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:00 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 Jul 09 15:33:00 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:01 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59" returned: 0 in 0.752s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:01 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d96da8a-9069-441e-a6da-078ea9661a67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:33:01 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[633cb682-46b8-48d3-89de-97e821c84073]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:01 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:01 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 Jul 09 15:33:01 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:02 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67" returned: 0 in 0.762s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:02 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 Jul 09 15:33:02 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:02 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59" returned: 0 in 0.722s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:02 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:02 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59 Jul 09 15:33:02 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:03 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67.ec4d6549-b225-4e8d-8b12-42b878cd5c59" returned: 0 in 0.623s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-ec4d6549-b225-4e8d-8b12-42b878cd5c59" released by "_delete_snapshot" :: held 2.940s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-3d96da8a-9069-441e-a6da-078ea9661a67" released by "delete_snapshot" :: held 2.963s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Created reservations ['4da3d9ab-d7d1-40a5-8178-5388e13d203f', '60a40043-81b2-4aa7-8692-f3a04776698f', 'abe3a0b7-4972-460f-bec5-22be1ce5978a', '3a0216c4-0b1e-45de-97d8-b2b03c8e6c11'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:33:03 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Delete snapshot completed successfully. Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-59ba98fa-e891-4f03-97c1-eff13d45daeb tempest-ProjectReaderTests-1048148721 None] Lock "cinder-ec4d6549-b225-4e8d-8b12-42b878cd5c59-delete_snapshot" released by "delete_snapshot" :: held 3.099s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-3d96da8a-9069-441e-a6da-078ea9661a67-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Lock "cinder-3d96da8a-9069-441e-a6da-078ea9661a67-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-3d96da8a-9069-441e-a6da-078ea9661a67" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-3d96da8a-9069-441e-a6da-078ea9661a67" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[3622dab1-09a4-4dc1-9648-65208fe597a5]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:03 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:03 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 Jul 09 15:33:03 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:04 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67" returned: 0 in 0.750s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:04 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:04 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67 Jul 09 15:33:04 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:05 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-3d96da8a-9069-441e-a6da-078ea9661a67" returned: 0 in 0.650s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-3d96da8a-9069-441e-a6da-078ea9661a67" released by "delete_volume" :: held 1.454s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Created reservations ['9d3df41d-85f2-4a3c-b871-770c0af73a4a', '4917db11-9d16-4693-bb23-5bc34f54f855', '5918f8bb-6136-4f18-9be9-78930d95c391', '90f45b54-53ef-4bc8-8110-556d94b108d3'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:05 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:33:05 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:05 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.648s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:33:05 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Deleted volume successfully. Jul 09 15:33:05 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-31075f61-198f-48e7-a819-ae31f5f1fb4f tempest-ProjectReaderTests-1048148721 None] Lock "cinder-3d96da8a-9069-441e-a6da-078ea9661a67-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Flow 'volume_create_manager' (dd211914-f240-44c0-9083-07960ac651c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1f1431-4069-43c8-b603-9fd18d8e4f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1f1431-4069-43c8-b603-9fd18d8e4f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059630022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfad9b77c26748c88338034e79c39e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:33:06Z,use_quota=True,user_id='9317d8e53e4944a9839d2e079dce94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea9f59a-6cd8-430c-921a-83154b6dad5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea9f59a-6cd8-430c-921a-83154b6dad5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b670efb-2adf-445c-82dd-85b8d575458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b670efb-2adf-445c-82dd-85b8d575458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8', 'volume_name': 'volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bdc373-2c7c-4ef0-8a38-9197bf9434c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bdc373-2c7c-4ef0-8a38-9197bf9434c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4374b36e-da03-4bb3-8aec-4a3c7a36a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:06 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Volume cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8', 'volume_size': 1} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059630022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfad9b77c26748c88338034e79c39e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:33:06Z,use_quota=True,user_id='9317d8e53e4944a9839d2e079dce94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Creating volume cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:33:06 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:33:06 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:06 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 1073741824 Jul 09 15:33:06 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:07 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 1073741824" returned: 0 in 0.806s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:07 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 Jul 09 15:33:07 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:07 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" returned: 0 in 0.645s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:07 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:33:07 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:33:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4374b36e-da03-4bb3-8aec-4a3c7a36a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ecdd03-a380-44ab-92b7-cce2a6fc41d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:07 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Volume volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 (cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8): created successfully Jul 09 15:33:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ecdd03-a380-44ab-92b7-cce2a6fc41d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:07 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Flow 'volume_create_manager' (dd211914-f240-44c0-9083-07960ac651c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:33:07 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-9c22b1c5-a3eb-4bf5-affc-097cf7d0ca74 tempest-ProjectReaderTests-1048148721 None] Created volume successfully. Jul 09 15:33:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:33:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:33:08 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Creating offline snapshot 1b7cfeba-8f24-4e9c-9d36-587eb1171fac of volume cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:33:08 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[df361331-b72e-4cee-ab49-066335b34f6c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:08 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:08 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 Jul 09 15:33:08 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:09 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" returned: 0 in 0.765s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:09 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:09 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac 1G Jul 09 15:33:09 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:10 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac 1G" returned: 0 in 0.810s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:10 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac Jul 09 15:33:10 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:10 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac" returned: 0 in 0.659s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:10 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac is being set with open permissions: ugo+rw Jul 09 15:33:10 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:10 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac Jul 09 15:33:10 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:11 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac" returned: 0 in 0.628s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:11 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:11 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.info Jul 09 15:33:11 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:12 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.info" returned: 0 in 0.622s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:12 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.info is being set with open permissions: ugo+rw Jul 09 15:33:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:12 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.info Jul 09 15:33:12 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:12 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.info" returned: 0 in 0.647s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:12 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.208s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:33:12 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-66f20d04-857b-49d4-b9ff-a3ddb12d8a85 tempest-ProjectReaderTests-1048148721 None] Create snapshot completed successfully Jul 09 15:33:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-1b7cfeba-8f24-4e9c-9d36-587eb1171fac-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Lock "cinder-1b7cfeba-8f24-4e9c-9d36-587eb1171fac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-1b7cfeba-8f24-4e9c-9d36-587eb1171fac" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:13 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-1b7cfeba-8f24-4e9c-9d36-587eb1171fac" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Deleting offline snapshot 1b7cfeba-8f24-4e9c-9d36-587eb1171fac of volume cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:33:13 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] snapshot_file for this snap is: volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:33:13 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b077e187-0eb3-43ba-b3d0-6f763588781c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:13 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:13 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac Jul 09 15:33:13 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:14 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac" returned: 0 in 0.741s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:14 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:33:14 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a2a055-53a6-4195-8ae7-12a6dbea182c]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:14 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:14 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 Jul 09 15:33:14 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:15 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" returned: 0 in 0.752s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:15 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:15 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac Jul 09 15:33:15 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:16 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac" returned: 0 in 0.724s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:16 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac Jul 09 15:33:16 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:16 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8.1b7cfeba-8f24-4e9c-9d36-587eb1171fac" returned: 0 in 0.642s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-1b7cfeba-8f24-4e9c-9d36-587eb1171fac" released by "_delete_snapshot" :: held 2.945s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" released by "delete_snapshot" :: held 2.971s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=62,cinder:UPDATE=74,cinder:INSERT=18,cinder:DELETE=8 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=55,cinder:INSERT=23,cinder:DELETE=5,cinder:UPDATE=72 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Created reservations ['bda90a78-da5b-48ad-99f3-ca48628b226c', 'a595d80d-a21e-4bbd-b902-f9fd1304d09b', 'bb56dd41-6253-4567-a6c7-02daa10b81c2', 'a4558096-4ac6-4364-8523-6e953fb805f8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:33:16 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Delete snapshot completed successfully. Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-c91d8864-c087-4f46-a506-61ba94a77d9e tempest-ProjectReaderTests-1048148721 None] Lock "cinder-1b7cfeba-8f24-4e9c-9d36-587eb1171fac-delete_snapshot" released by "delete_snapshot" :: held 3.115s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:16 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" acquired by "delete_volume" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:17 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef884dc7-c528-498d-8512-51bc3a272902]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:17 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 Jul 09 15:33:17 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:17 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" returned: 0 in 0.751s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:17 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:17 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8 Jul 09 15:33:17 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:18 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" returned: 0 in 0.636s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:18 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8" released by "delete_volume" :: held 1.442s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:18 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Created reservations ['5510c992-63c0-4219-acf6-482650873d60', '514de9ba-f868-4fc4-9955-82d5af24e333', 'a6224bfe-f58c-428e-baf9-8800dbaf3bf9', '2e533548-2635-4579-9821-681f826a91e4'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:33:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:33:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:33:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:33:18 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:33:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:33:18 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:18 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:33:18 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:19 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.686s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:33:19 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Deleted volume successfully. Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-65b1aeea-53be-446e-81f3-8bae8de35b14 tempest-ProjectReaderTests-1048148721 None] Lock "cinder-cc07c145-11c9-4eca-bb7f-8d8a9f7e1ab8-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86916) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Flow 'volume_create_manager' (d3851ab4-c410-4735-957d-a4a78d4daef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de32a1ec-43f0-4ede-9ee6-5abd96a97428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de32a1ec-43f0-4ede-9ee6-5abd96a97428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1921554190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7218427a-b382-4465-801c-bfd1d845fac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfad9b77c26748c88338034e79c39e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:33:20Z,use_quota=True,user_id='9317d8e53e4944a9839d2e079dce94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03fac45-102a-4da8-b7e7-b340f7f1e3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03fac45-102a-4da8-b7e7-b340f7f1e3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda389c7-5544-4d1c-be2f-58d34039b8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda389c7-5544-4d1c-be2f-58d34039b8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7218427a-b382-4465-801c-bfd1d845fac5', 'volume_name': 'volume-7218427a-b382-4465-801c-bfd1d845fac5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70eee954-3603-4534-af5e-300e03e7ba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70eee954-3603-4534-af5e-300e03e7ba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abe1688-4d1a-4771-8dc7-2a230988fbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:19 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Volume 7218427a-b382-4465-801c-bfd1d845fac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7218427a-b382-4465-801c-bfd1d845fac5', 'volume_size': 1} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T13:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1921554190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7218427a-b382-4465-801c-bfd1d845fac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfad9b77c26748c88338034e79c39e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T13:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T13:33:20Z,use_quota=True,user_id='9317d8e53e4944a9839d2e079dce94ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c74553-f26f-45b6-a741-6cab754ed94a),volume_type_id=a4c74553-f26f-45b6-a741-6cab754ed94a)}" {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Creating volume 7218427a-b382-4465-801c-bfd1d845fac5 {{(pid=86916) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Selected osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b as target Quobyte volume. {{(pid=86916) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 15:33:19 devstack cinder-volume[86916]: INFO cinder.volume.drivers.remotefs [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] casted to osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b Jul 09 15:33:19 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 1073741824 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:19 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 1073741824 Jul 09 15:33:19 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:20 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 1073741824" returned: 0 in 0.806s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:20 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:20 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 Jul 09 15:33:20 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:21 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'} {{(pid=86916) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abe1688-4d1a-4771-8dc7-2a230988fbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7218427a-b382-4465-801c-bfd1d845fac5', 'volume_size': 1}' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028e304e-5e88-494b-98a4-cbee7026968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 15:33:21 devstack cinder-volume[86916]: INFO cinder.volume.flows.manager.create_volume [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Volume volume-7218427a-b382-4465-801c-bfd1d845fac5 (7218427a-b382-4465-801c-bfd1d845fac5): created successfully Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028e304e-5e88-494b-98a4-cbee7026968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86916) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Flow 'volume_create_manager' (d3851ab4-c410-4735-957d-a4a78d4daef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86916) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 15:33:21 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-ecd05ef9-7174-4405-b73a-a94b57533b99 tempest-ProjectReaderTests-1048148721 None] Created volume successfully. Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Creating offline snapshot 75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 of volume 7218427a-b382-4465-801c-bfd1d845fac5 {{(pid=86916) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f26e793-9eed-4e21-bef1-d63d74a144db]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:21 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:21 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 Jul 09 15:33:21 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:22 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5" returned: 0 in 0.733s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:22 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 1G {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:22 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 1G Jul 09 15:33:22 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:23 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 1G" returned: 0 in 0.767s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7218427a-b382-4465-801c-bfd1d845fac5 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:23 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7218427a-b382-4465-801c-bfd1d845fac5 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 Jul 09 15:33:23 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:23 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7218427a-b382-4465-801c-bfd1d845fac5 -F qcow2 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6" returned: 0 in 0.689s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:23 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 is being set with open permissions: ugo+rw Jul 09 15:33:23 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:24 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 Jul 09 15:33:24 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:24 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6" returned: 0 in 0.630s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:24 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:24 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.info Jul 09 15:33:24 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:25 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.info" returned: 0 in 0.654s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:25 devstack cinder-volume[86916]: WARNING cinder.volume.drivers.remotefs [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.info is being set with open permissions: ugo+rw Jul 09 15:33:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.info {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:25 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.info Jul 09 15:33:25 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:25 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.info" returned: 0 in 0.630s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:25 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.176s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:33:25 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-eb7525d5-ae95-4b95-8dc3-5f7b05c2a1e7 tempest-ProjectReaderTests-1048148721 None] Create snapshot completed successfully Jul 09 15:33:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6-delete_snapshot" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Lock "cinder-75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:26 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-7218427a-b382-4465-801c-bfd1d845fac5" by "delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-7218427a-b382-4465-801c-bfd1d845fac5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6" by "_delete_snapshot" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Deleting offline snapshot 75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 of volume 7218427a-b382-4465-801c-bfd1d845fac5 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] snapshot_file for this snap is: volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 {{(pid=86916) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8838520-7ce7-4270-8faa-17426796d631]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:27 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 Jul 09 15:33:27 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:27 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6" returned: 0 in 0.742s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.remotefs [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7218427a-b382-4465-801c-bfd1d845fac5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86916) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efce08e-e0bb-4b52-a01f-905a3cf163ae]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:27 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:27 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 Jul 09 15:33:27 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:28 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5" returned: 0 in 0.742s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:28 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:28 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 Jul 09 15:33:28 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:29 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6" returned: 0 in 0.711s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:29 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6 Jul 09 15:33:29 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:29 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:29 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5.75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6" returned: 0 in 0.626s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6" released by "_delete_snapshot" :: held 2.905s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:29 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-7218427a-b382-4465-801c-bfd1d845fac5" released by "delete_snapshot" :: held 2.928s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:29 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Created reservations ['381d743f-7a44-40ab-a986-9e1c828410b1', '6d826761-aaad-4a32-8197-f20738d969b6', 'b74b41c8-0775-4fb5-be66-dde9f6656558', '9869a226-5e78-4df2-90b7-2782cae69dd8'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:33:30 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Delete snapshot completed successfully. Jul 09 15:33:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-13dfc879-711e-458e-a1e9-d19640678abe tempest-ProjectReaderTests-1048148721 None] Lock "cinder-75debf4a-d9e6-4b6d-a4f2-fcf1dfbc1ac6-delete_snapshot" released by "delete_snapshot" :: held 3.054s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-7218427a-b382-4465-801c-bfd1d845fac5-delete_volume" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Lock "cinder-7218427a-b382-4465-801c-bfd1d845fac5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Acquiring lock "cinder-quobyte-7218427a-b382-4465-801c-bfd1d845fac5" by "delete_volume" {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 15:33:30 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-7218427a-b382-4465-801c-bfd1d845fac5" acquired by "delete_volume" :: waited 0.014s {{(pid=86916) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 15:33:30 devstack cinder-volume[86916]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe9763-8bff-4ae5-b4c5-43137a3d0deb]: (4, 'qcow2') {{(pid=87901) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 15:33:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:30 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 Jul 09 15:33:30 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:30 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5" returned: 0 in 0.731s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:30 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:31 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5 Jul 09 15:33:31 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:31 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d/volume-7218427a-b382-4465-801c-bfd1d845fac5" returned: 0 in 0.632s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:31 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Lock "cinder-quobyte-7218427a-b382-4465-801c-bfd1d845fac5" released by "delete_volume" :: held 1.417s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:31 devstack cinder-volume[86916]: DEBUG cinder.quota [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Created reservations ['6455814d-3a55-4976-9652-22d312e27e43', 'd5b7e8a5-1fe7-42d7-b1fd-d975326e48ea', 'ed052822-6a26-4ec0-8998-7e62c19972e7', '74693b3b-eb79-4767-981e-204fc77832c1'] {{(pid=86916) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 15:33:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:33:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:33:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:33:31 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:33:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:33:31 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:31 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:33:31 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:32 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:32 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.641s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:32 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:33:32 devstack cinder-volume[86916]: INFO cinder.volume.manager [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Deleted volume successfully. Jul 09 15:33:32 devstack cinder-volume[86916]: DEBUG cinder.coordination [None req-3b961701-e5ee-45c6-b754-4c965e61667f tempest-ProjectReaderTests-1048148721 None] Lock "cinder-7218427a-b382-4465-801c-bfd1d845fac5-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=86916) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 15:33:41 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:INSERT=8,cinder:UPDATE=34,cinder:SELECT=18,cinder:DELETE=1 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:33:42 devstack cinder-volume[86916]: DEBUG dbcounter [-] [86916] Writing DB stats cinder:SELECT=27,cinder:INSERT=10,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=86916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 15:33:47 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:33:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 15:33:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 15:33:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b': None} {{(pid=86916) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 15:33:47 devstack cinder-volume[86916]: DEBUG cinder.volume.drivers.quobyte [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-14b3f3b4-c903-4d3f-a317-b6966459731b'] {{(pid=86916) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 15:33:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.lockutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86916) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 15:33:47 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 15:33:47 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d Jul 09 15:33:47 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 15:33:48 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 09 15:33:48 devstack cinder-volume[86916]: DEBUG oslo_concurrency.processutils [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/715d77f72df091f6a598c42687da5b0d" returned: 0 in 0.612s {{(pid=86916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 15:33:48 devstack cinder-volume[86916]: DEBUG cinder.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Notifying Schedulers of capabilities ... {{(pid=86916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 15:33:48 devstack cinder-volume[86916]: DEBUG oslo_service.periodic_task [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] Running periodic task VolumeManager._thread_info {{(pid=86916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 15:33:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread count: 28 {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 15:33:48 devstack cinder-volume[86916]: DEBUG cinder.volume.manager [None req-a3ab01e5-1c59-4e5a-a054-ac5df7058c6e None None] thread info: [<_MainThread(MainThread, started 132263055671424)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}